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ABSTRACT 

The  purpose  of  this  study  was  to  determine  industry 
perceptions  of  the  Department  of  Defense's  Cost/Schedule 
Control  Systems  Criteria  (C/SCSC)  and  to  determine  whether 
or  not  the  original  objectives  of  the  C/SCSC  have  been 
fulfilled.  Interviews  were  conducted  with  contractors  from 
highly  varied  fields  of  endeavor  in  order  to  achieve 
opinions  from  a  wide  spectrum  of  the  defense  industry. 
Responses  were  analyzed  to  ascertain  what  areas  require 
improvement  and  to  form  conclusions  on  the  value  of  the 
C/SCSC. 
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I.   INTRODUCTION 


A.   PURPOSE 

It  has  been  15  years  since  Department  of  Defense  (DOD) 
Instruction  7000.2,  entitled  "Performance  Measurement  for 
Selected  Acquisitions,"  promulgated  the  formal  Cost/Sche- 
dule Control  Systems  Criteria  (C/SCSC)  implementation. 
While  the  concept  has  not  changed  materially  through  the 
years,  a  multitude  of  detailed  guidance  procedures  have 
ensued.  A  program  which  contractors  initially  felt  to  be  a 
passing  management  fancy  has  evolved  into  a  highly  sophis- 
ticated and  demanding  management  control  system  [Ref.  1]. 

The  C/SCSC  has  had  ample  time  to  mature  in  the  major 
systems  acquisition  environment,  but  the  debate  over  its 
relative  merit  has  continued  [Ref.  2].  The  primary  purpose 
of  this  study  is  to  survey  defense  contractors  to  obtain 
their  perceptions  of  the  C/SCSC.  The  contractor's  opinions 
on  whether  or  not  the  objectives  of  DOD  Instruction  7000.2 
are  being  met  within  its  stated  policy  guidelines  is  of 
particular  interest  to  the  author.  A  secondary  purpose  is 
to  determine  where  the  major  problem  areas  exist  and  to 
explore  the  relative  cost  effectiveness  and  utility  of 
C/SCSC.  By  providing  a  vehicle  for  contractor  opinions,  it 
is  hoped  that  their  perceptions  will  receive  appropriate 
visibility . 


B.   SCOPE 

The  study  centered  on  interviews  with  five  defense 
contractors.  The  contractors  were  selected  from  highly 
varied  sectors  of  the  military  industrial  complex.  Special 
care  was  taken  to  achieve  a  sample  which  was  representative 
of  the  United  States  (U.S.)  Navy,  U.S.  Air  Force,  and  U.S. 
Army  contractors.  The  sample  was  purposely  held  small  due 
to  time  and  travel  constraints  on  the  part  of  the  author. 
In  order  to  elicit  sincere  responses,  the  contractors  were 
insured  anonymity;  therefore,  no  reference  to  a  specific 
company  will  be  found  in  the  study. 

C.   RESEARCH  METHODOLOGY 

The  method  for  conducting  this  study  included  a  combir 
nation  of  questionnaires,  follow-up  phone  conversations, 
and  actual  interviews.  The  study  was  supplemented  by  a 
comprehensive  literature  review.  Knowledge  gleaned  through 
past  research  was  utilized  as  a  basis  for  further 
investigation . 

The  author  made  several  assumptions  to  facilitate  this 
research.  First,  the  contractors  selected  for  participa- 
tion in  this  study  are  representative  of  typical  defense 
contractors  operating  under  the  C/SCSC.  Second,  those 
individuals  who  participated  in  the  study  gave  the  view- 
point of  the  corporate  entity  rather  than  personal 
opinions.   Finally,  C/SCSC  has  been  refined  for  15  years, 


yet  it  still  can  be  improved  as  a  management  tool,  Both 
the  government  and  industry  will  benefit  from  any  concrete 
suggestions  for  improvement  of  the  C/SCSC. 

D.   THESIS  ORGANIZATION 

Chapter  II  -  Historical  evolution  of  the  C/SCSC  from 

inception  through  implementation 

Chapter  III  -  Contractor  perceptions  of  the  C/SCSC  with 

emphasis  on  its  advantages,  limitations,  and  cost 

effectiveness . 

Chapter  IV  -  Conclusions  and  Recommendations 


11 •   HISTORICAL  EVOLUTION 

This  chapter  will  portray  the  historical  evolution  of 
the  C/SC3C.  It  covers  the  creation  of  the  system,  its 
basic  fundamentals,  the  implementation  process,  surveil- 
lance process,  and  the  reporting  methodology. 

The  Department  of  Defense  has  recognized  the  need  for 
improved  methods  of  controlling  costs  and  of  determining 
program  progress  since  the  early  1950's  [Ref.  33*  This 
recognition  led  to  several  innovative  systems  or  methods 
from  the  various  agencies  of  DOD .  Among  the  first  to  be 
developed  was  the  Department  of  the  Navy's  (DON)  Program 
Evaluation  Review  Technique  (PERT).  It  gained  popularity 
and  acclaim  when  it  was  developed  and  utilized  on  the 
highly  successful  Polaris  Program  [Ref.  33.  Subsequently, 
PERT  grew  to  have  several  modifications,  such  as  PERT/COST 
and  PERT/TIME,  each  an  attempt  to  better  understand  program 
cost,  schedule,  and  performance.  PERT  dominated  the  scene 
of  management  information  techniques  throughout  the  50 ' s 
and  into  the  60's;  however,  it  was  not  without  its 
problems.  A  multitude  of  status  reports  flourished;  each 
report  based  upon  a  different  agency's  requirement  and 
differing  formats.  To  further  complicate  the  situation, 
many  contractors  were  unwilling  to  sacrifice  their  own 


internal  management  systems  which  has  taken  years  to  evolve 
[Ref.  11.  The  government  established  PERT  Cost  Groups 
whose  purpose  was  to  transpose  data  from  the  contractor's 
management  system  into  PERT  formats.  This  process  was 
costly,  and  relevant  data  was  often  lost  or  made  untrace- 
able during  transposition  [Ref.  31. 

The  Assistant  Secretary  of  Defense  (Comptroller) 
decided  that  DOD  should  remove  itself  from  the  business  of 
management  systems  design,  and  it  should  rely  upon  the 
contractor's  internal  control  systems.  This  decision 
necessitated  some  assurance  that  all  contractors  would 
integrate  their  data  about  some  common  baseline  which  would 
be  effective  for  government  analysis  purposes.  The  common 
baseline  was  developed  in  1966  though  the  Director,  Defense 
Research  and  Engineering,  and  it  was  in  the  form  of  a 
standard  work  breakdown  structure  (MIL-STD-88 1 )  .  The 
assurance  of  effectiveness  was  addressed  through  a  set  of 
criteria  developed  by  the  Department  of  the  Air  Force's 
Cost/Schedule  Planning  and  Control  Systems  (C/SPCS). 
C/SPCS  evolved  from  the  Air  Force's  experience  over  the 
years  with  aerospace  contractors.  In  1967,  the  new 
criteria  was  promulgated  through  DOD  Instruction  7000.2, 
"Performance  Measurement  for  Selected  Acquisitions,"  and 
the  criteria  was  named  the  Cost/Schedule  Control  Systems 
Criteria  (C/SCSC)  [Ref.  4]. 


The  C/SCSC  established  the  characteristics  a  con- 
tractor's internal  management  system  must  possess  to  insure 
effective  planning  and  to  control  contract  costs  and 
schedules.  These  characteristics  were  based  on  the  premise 
that  the  following  basic  features  should  exist  in  some  form 
in  every  management  control  system  [Ref.  53: 

1.  Organization  -  define  contractual  effort  and  assign 
responsibilities  for  the  work; 

2.  Planning  -  plan,  schedule,  budget  and  authorize 
resources  ; 

3.  Accounting  -  accumulate  costs  of  work  and  material; 

4.  Reporting  -  compare  planned  and  actual  costs  and 
analyze  variances;  and 

5.  Revisions   -   incorporate   changes   and   develop 
estimates  of  final  costs. 

DOD  Instruction  7000.2  delineates  the  following  policy  and 
procedures  : 

1.  Minimizes  changes  to  contractor's  existing  systems; 

2.  Single  system  for  internal  management  and  govern- 
ment reporting; 

3.  Avoid  imposition  of  specific  systems;  and 

4.  Avoid  proliferation  of  demands  for  demonstrations 
of  systems. 

The  following  objectives  of  C/SCSC  are  illustrated  in  DOD 
Instruction  7000.2: 


1.  To  insure  that  DOD  contractors  use  effective 
management  control  systems  and  procedures;  and 

2.  To  insure  that  contractors'  systems  provide  data 
which:  indicate  work  progress;  properly  relate 
cost,  schedule,  and  technical  performance;  are 
valid,  timely,  and  auditable;  and,  supply  DOD 
managers  with  a  practicable  level  of  summarization. 

The  basic  concepts  of  C/SCSC  are  as  follows: 

1.  Plan  the  entire  contractual  effort; 

2.  Determine  accomplishment  at  a  level  where  work  is 
done  ; 

3.  Measure  accomplishment  objectively; 

4.  Summarize  for  higher  levels;  and 

5.  Analyze  variances  and  forecast  impact  [Ref.  51. 

The  contractor's  internal  system  must  provide  the  following 
data  : 

1.  Budgeted  cost  for  work  scheduled  to  be  performed, 

2.  Budgeted  cost  for  work  actually  performed, 

3.  Actual  cost  of  work  performed, 

4.  Budgeted  cost  for  completed  contract, 

5.  Latest  estimate  of  cost  at  completion, 

6.  Cost  and  schedule  variances  and  their  reasons,  and 

7.  Ability  to  trace  problems  to  their  source  [Ref. 5]. 

A  viable  illustration  of  a  contractor's  work  breakdown 
structure  (W3S)  is  in  the  shipbuilding  industry.   Work  is 
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required  to  be  broken  down  into  nine  categories  called  cost 
groups  (CG):  CG100-hull,  CG200-propuls ion ,  CG300- 
electrical,  CG400-command  and  control,  CG500-aux il iar y 
systems,  CG600-outf itting ,  CG700-weapons ,  CG800-engineering 
and  integration,  and  CG900-support  systems.  Each  cost 
group  is  further  broken  down  into  individual  cost  accounts. 
The  cost  account  is  the  key  management  control  point  in  the 
C/SCSC.  Functional  responsibility,  work  planning  and 
assignment,  cost  collection,  data  summation,  and  corrective 
action  are  all  focused  by  the  cost  account.  Various  work 
package  data  is  summed  up  to  the  appropriate  cost  account 
level.  For  example,  ventilation  systems  is  cost  account 
512. 

The  contractor  is  then  required  to  plan  and  budget  all 
work  to  be  accomplished  in  every  cost  account.  The  budget 
is  considered  the  standard,  and  all  performance  is  measured 
in  relation  to  the  established  budget.  Actual  performance 
is  quantified  through  a  job  order  costing  system  which  is 
summed  up  from  each  individual  work  order.  The  actual 
performance  in  each  cost  account  is  compared  to  the  bud- 
geted standard,  and  the  applicable  variances  are  available 
for  analysis.  The  cost  variance  is  the  difference  between 
the  budgeted  cost  of  work  performed  (BCWP)  and  the  actual 
cost  of  work  performed  (ACWP).  The  schedule  variance  is 
the  difference  between  the  budgeted  cost  of  work  performed 
(BCWP)  and  the  budgeted  cost  of  work  scheduled  (BCWS). 
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After  thorough  analysis,  corrective  action  can  be  taken 
by  management  on  an  individual  case  basis.  A  credible 
Cost/Schedule  Control  System  is  maintained  through  constant 
auditing  by  the  contractor  and  systematic  monthly  auditing 
by  government  personnel. 

Implementation  of  C/SCSC  is  prescribed  by  DOD  Instruc- 
tion 7000.2  for  selected  contracts  designated  as  major 
defense  systems  according  to  DOD  Directive  5000.1,  "Acqui- 
sition of  Major  Defense  Systems."  Programs  are  designated 
major  defense  systems  based  upon  one  of  the  following:  an 
estimated  Research,  Development,  Test  and  Evaluation 
(RDT&E)  cost  in  excess  of  $100  million;  an  estimated 
production  cost  in  excess  of  $500  million;  simply  on 
national  urgency;  or,  by  recommendations  of  DOD  components 
or  the  Secretary  of  Defense.  Subcontracts  may  be  selected 
for  application  of  C/SCSC  by  mutual  agreement  between  the 
prime  contractor  and  the  procuring  activity,  according  to 
the  criticality  of  the  subcontract  to  the  program.  Fixed 
price  contracts  or  fixed  price  (Economic  Price  Adjustment) 
contracts  or  subcontracts  cannot  be  selected  for  applica- 
tion of  C/SCSC.  All  other  types  of  contracts,  including 
fixed-price  incentive,  may  have  C/SCSC  applied  [Ref.  6,7]. 

The  procuring  activity  has  the  responsibility  for 
determining  if  a  procurement  requires  C/SCSC  on  new  or 
existing  programs.    Once  the  decision  is  made  to  apply 
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C/SCSC  on  a  new  procurement,  the  proper  Defense  Acquisition 
Regulation  (DAR)  clause  is  included  in  the  solicitation 
document.  A  contractor  responding  to  the  solicitation  is 
required  to  indicate  the  extent  to  which  the  existing 
management  control  system  meets  the  criteria  in  DOD 
Instruction  7000.2,  and  how  the  present  system  could  be 
changed  to  comply  with  the  criteria.  The  procuring 
activity  has  the  responsibility  of  evaluating  the  response 
[Ref.  73. 

Prior  to  contract  award,  the  Contract  Administration 
Office  (CAO)  and  Defense  Contract  Audit  Agency  (DCAA)  will 
respond  to  any  of  the  procuring  activity's  queries 
regarding  the  contractor's  response  to  the  solicitation, 
its  present  operation,  and  its  ability  to  meet  the  C/SCSC. 
Where  there  is  a  current  contract  which  has  C/SCSC 
provisions,  the  CAO  can  answer  questions  relative  to  how 
the  contractor  is  performing  in  accordance  with  C/SCSC 
requirements.  They  can  also  provide  any  other  pertinent 
information . 

Normally  for  a  new  program,  an  evaluation  review  is 
accomplished  as  part  of  the  ?re-award  Survey  procedures. 
The  review  is  basically  an  analysis  of  the  contractor's 
management  control  system  proposed  in  response  to  the 
solicitation.  Normally,  an  on-site  examination  of  the 
contractor's   system   in  operation  will  not  be  required 
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during  the  evaluation  review.  However,  when  any  part  of 
the  contractor's  system  is  not  clearly  understood,  on-site 
examination  of  that  part  may  be  necessary  to  clarify  the 
contractor's  intent.  Approval  of  the  activity  responsible 
for  source  selection  must  be  obtained  if  the  on-site  audit 
is  utilized  . 

Following  the  evaluation  review,  a  written  report  must 
be  prepared  by  the  evaluation  review  team.  It  should 
attest  to  whether  or  not  the  contractor's  system  descrip- 
tion in  the  proposal  adequately  describes  compliance  with 
the  criteria.  If  not,  the  report  will  identify  the 
specific  deficiencies,  and  it  will  be  forwarded  to  the 
Source  Selection  Evaluation  Board  for  final  resolution 
[Ref.  71. 

The  contractor  must  be  prepared  within  90  days  after 
award  of  the  contract  to  demonstrate  that  its  management 
system  meets  the  criteria  of  DOD  Instruction  7000.2. 
Usually  within  30  days  of  contract  award,  representatives 
of  the  C/SCSC  review  team  go  to  the  contractor's  plant  for 
an  implementation  visit.  This  visit  is  to  insure  the 
proper  communication  of  the  requirements  and  to  demonstrate 
the  procedures. 

A  readiness  assessment  is  held  shortly  before  the 
actual  demonstration  review,  insuring  that  the  contractor 
is  ready  for  the  full-scale  demonstration.    During  the 
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official  demonstration  review,  the  contractor's  entire 
C/SCSC  operation  is  scrutinized.  The  contractor  is 
required  to  make  available  the  documents  used  in  its 
management  control  system;  for  example,  budgeting,  work 
authorization,  accounting,  and  other  functional  documents 
which  apply  to  the  specific  contracts  being  reviewed.  The 
documentation  must  be  current  and  accurate.  The  burden  of 
proof  for  demonstrating  compliance  with  the  criteria 
necessarily  rests  with  the  contractor. 

Any  major  discrepancies  which  are  uncovered  will  be 
subsequently  reexamined  to  determine  acceptability  by  the 
review  director.  Some  of  the  most  common  problems 
encountered  are  as  follows: 

1.  Organization  -  inadequate  work  breakdown  structure 
(WBS)  and  poor  work  definition  at  working  levels; 

2.  Planning  and  Budgeting  -  over  allocation  of  budget, 
and  poor  integration  of  budget,  schedule,  and  work 
authorization ; 

3.  Accounting  -  inability  to  account  for  cost  of 
material  on  an  applied  basis; 

4.  Analysis  -  determination  of  status  not  based  on 
work  package  completions,  and  comparisons  of  actual 
vs  planned  costs  at  improper  levels; 

5.  Revisions  -  failure  to  maintain  valid  measurement 
baseline  . 
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At  the  conclusion,  a  formal  C/SCSC  report  is  prepared  and 
forwarded  to  the  procuring  activity  and  to  the  major 
command  responsible  for  implementation  of  the  criteria 
(NAVMAT  023  in  the  case  of  the  Navy).  Upon  receipt  of  the 
report,  the  Procuring  Contracting  Officer  (PCO)  will  inform 
the  contractor  regarding  the  acceptance  or  nonacceptance  of 
its  system  [Ref.  71. 

Acceptance  of  the  contractor's  management  control 
system  is  not  intended  to  inhibit  continuing  innovations 
and  improvement  of  its  system.  However,  the  contractor  is 
contractually  obligated  to  maintain  its  system  in  a  state 
which  satisfies  the  criteria. 

Surveillance  to  insure  that  the  contractor  does  not 
comply  is  a  DOD  management  responsibility  accomplished  by 
the  cognizant  CAO  and  DCAA.  Immediately  following 
acceptance  of  the  contractor's  validated  system,  sur- 
veillance should  be  formalized  to  include  a  comprehensive 
program  covering  the  complete  scope  of  the  criteria.  Such 
a  program  should  provide  for  verifying,  tracing,  and 
evaluating  the  information  contained  in  reports  submitted 
to  DOD  procuring  components.  It  also  should  insure  that 
the  contractor's  management  control  system  continues  to 
operate  as  validated,  and  any  proposed  or  actual  changes 
comply  with  DOD  Instruction  7000.2. 
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The  surveillance  plan  should  support  the  program  mana- 
ger's needs  and  avoid  duplication  of  effort.  The  CAO  and 
program  manager's  representative  establish  a  mutual  under- 
standing in  a  Memorandum  of  Agreement  (MOA)  as  to  their 
particular  responsibilities.  The  surveillance  plan  should 
be  written  to  satisfy  these  requirements.  C/SCSC  does  not 
obviate  any  of  the  techniques,  functions,  or  responsibili- 
ties normally  accomplished  by  the  CAO.  However,  it  does 
facilitate  the  use  of  the  more  classical  methods  of 
contract  administration  [Ref.  8].  For  example,  the  monthly 
Cost  Performance  Report  (CPR)  shows  the  cost/schedule 
status  of  the  contract  for  the  previous  monthly  period.  It 
highlights  significant  cost/schedule  variances  that  have 
occurred  and  their  probable  causes.  The  data  in  the  CPR 
quantify  the  magnitude  of  existing  problems  and  potential 
problems  and  immediate  cost/schedule  trends  which  are  used 
for  estimating  contract  completion  costs.  The  CPR  consists 
of  five  formats  [Ref.  9]: 

1.  Format  1  -  Work  Breakdown  Structure:  provides  data 
to  measure  cost  and  schedule  performance  by  summary 
level  work  breakdown  structure  elements; 

2.  Format  2  -  Functional  Categories:  provides  data  to 
measure  cost  and  schedule  performance  by  organiza- 
tion or  functional  cost  categories; 

3.  Format  3  -  3aseline:  provides  the  budget  baseline 
plan  against  which  performance  is  measured; 
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4.  Format  4  -  Manpower  Loading:  provides  manpower 
loading  forecasts  for  correlation  with  the  budget 
plan  and  cost  estimate  predictions; 

5.  Format  5  -  Problem  Analysis:  provides  a  narrative 
report  used  to  explain  significant  cost  and 
schedule  variances  and  other  identified  contract 
problems . 

The  CPR  is  not  intended  to  provide  the  first  indication 
of  a  problem  on  a  program.  Its  purpose  is  to  furnish  the 
program  manager  with  the  impact  or  quantification  of  such 
problems,  to  outline  any  trends  which  may  be  developing, 
and  to  furnish  a  basis  for  a  detailed  analysis  of  the 
financial  status  of  the  contract.  Reliable  data  in  this 
format  is  very  useful  for  effective  contract  administration 
as  well  as  program  management  decision  making. 

The  C/SCSC  provides  the  following  major  benefits  to  the 
Program/Project  Office: 

1.  Confidence  in  the  contractor's  internal  management 
system , 

2.  Objective  (rather  than  subjective)  contract  status 
information  , 

3.  Cost  impact  of  known  problems, 

4.  Capability  to  trace  problems  to  the  source  through 
the  work  breakdown  system  (WBS)  to  the  cost  account 
level , 
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5.  Quantitative  measure  of  schedule  deviation, 

6.  Measurement  against  a  contract  oriented  baseline. 
In  August  1974,  DOD  Instruction  7000.10  established  the 

Cost/Schedule  Status  Report  (C/SSR)  as  a  standard  means  for 
reporting  summarized  cost/schedule  performance  on  contracts 
which  do  not  qualify  as  major  acquisitions.  Unlike  the 
C/SCSC  CPR  approach,  the  C/SSR  requirement  neither  esta- 
blishes any  minimum  requirements  with  respect  to  the  con- 
tractor's management  systems  nor  involves  the  evaluation, 
acceptance,  or  rejection  of  the  contractor's  internal 
management  procedures.  Incentive  or  cost-reimbursable  type 
contracts  larger  than  $2  million,  and  with  a  duration 
exceeding  one  year,  are  candidates  for  C/SSR  application. 

While  the  actual  C/SSR  appears  to  be  a  scaled  down 
version  of  the  CPR,  there  are  some  differences  which  should 
be  noted.  The  C/SSR  neither  requires  cost  performance 
reporting  on  a  functional  (organizational)  basis  nor 
requires  incremental,  current  period  reporting.  In  addi- 
tion, the  C/SSR  does  not  require  the  baseline  and  manpower 
loading  required  by  the  CPR.  For  CPR  reporting,  budgeted 
cost  of  work  scheduled  (BCWS)  and  budgeted  cost  of  work 
performed  (BCWP)  must  be  the  result  of  the  direct  summation 
of  work  packages.  The  C/SSR  permits  the  determination  of 
these  values  through  any  reasonably  accurate,  mutually 
acceptable  means.   Data  required  on  the  C/SSR  are  organized 
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by  summary  level  work  breakdown  structure  (WBS)  elements, 
Generally,  reporting  does  not  extend  below  level  3  of  the 
contract  WBS,  and,  in  some  applications,  level  2  will 
suffice  [Ref.  10]. 

In  summary,  the  government  has  taken  a  systematic 
approach  at  achieving  commonality  in  the  management  control 
and  reporting  of  major  weapon  system  contractors.  The  next 
chapter  will  investigate  contractor  perceptions  of  the 
C/SCSC  with  emphasis  on  its  advantages,  limitations,  and 
cost  effectiveness. 
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III.   CONTRACTOR  PERCEPTIONS 

This  chapter  centers  on  discussions  with  five  defense 
contractors  who  were  selected  from  the  aerospace,  elec- 
tronics, and  shipbuilding  industries.  The  author  choose 
contractors  with  seasoned  experience  and  appreciable 
contract  dollar  variance  with  the  C/SCSC,  and  the  judge- 
mental sample  was  considered  to  be  representative  of  the 
U.S.  Navy,  U.S.  Air  Force,  and  U.S.  Army  contractors.  The 
participating  firms  are  dispersed  geographically  throughout 
the  entire  United  States. 

The  author  encountered  no  difficulties  in  eliciting 
responses  from  the  sampled  contractors.  In  fact,  they 
welcomed  the  opportunity  to  give  their  candid  opinions  in 
this  forum.  The  following  contractor  opinions  are  a 
compilation  of  those  responses  with  emphasis  on  the  con- 
formity of  the  various  replies.  No  statistical  inferences 
are  implied  due  to  the  very  small  sample  size,  but  the 
author  feels  that  the  participating  firms  are  well  quali- 
fied to  give  meaningful  opinions. 

In  an  effort  to  originate  discussions,  both  on-site  and 
telephone,  the  author  used  a  brief  guided  questionnaire. 
The  subsequent  discussions  were  intentionally  handled  in  an 
open-ended  manner  to  allow  the  contractors  to  openly 
discuss  their  perceptions  of  the  C/SCSC. 
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Again,  the  author  reiterates  that  the  following  pages 
depict  the  C/SCSC  as  the  sampled  contractor's  viewpoint, 
not  the  government  or  statistical  inference. 

The  major  advantages  and  limitations  of  utilizing  the 
C/SCSC  became  readily  apparent  during  the  course  of  this 
research  study. 

The  C/SCSC  discipline  helps  to  insure  that  all  work  is 
properly  planned,  and  the  budget,  schedule,  manpower,  and 
organizational  elements  are  all  considered  in  the  planning 
process.  C/SCSC  requires  all  work  to  be  subdivided  into 
elements  down  to  the  level  where  the  work  is  to  be  per- 
formed. The  general  requirement  specifies  that  work 
packages  be  planned  in  detail  six  months  in  advance  of  the 
work  start  date.  All  other  work  beyond  this,  time  frame 
must  be  planned  at  a  more  general  level.  Advanced  planning 
helps  insure  that  all  of  the  work  necessary  to  complete  a 
major  program  is  included  in  the  master  plan;  therefore, 
nothing  is  overlooked  or  put  off  to  the  last  moment.  The 
C/SCSC  insures  that  the  cost  of  performing  all  work  is 
considered  from  the  outset  and  insures  that  budgets  are 
appropriately  applied  early  in  the  program.  The  initial 
planning  and  budgeting  discipline  gives  management  an  early 
overview  of  the  entire  program,  thereby  helping  to  esta- 
blish the  relative  priorities  of  each  facet  of  the 
endeavor  . 
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Management  is  obligated  to  closely  consider  the 
requirements  of  accomplishing  each  task  and  to  insure  that 
schedule  and  cost  projections  are  as  realistic  as  possible. 
This  condition  is  brought  about  since  the  budgets  become 
the  baseline  against  which  future  performance  is  measured, 
thereby  enforcing  discipline  within  the  planning  process  as 
well.  Work  which  has  been  closely  scrutinized  and  planned 
is  normally  accomplished  to  a  higher  degree  of  efficiency. 

The  C/SCSC  improves  communications,  not  only  within  the 
organization,  but  between  the  corporation  and  the  govern- 
ment. Communications  are  simpler  and  better  as  a  result  of 
the  common  language  and  standardized  documentation. 
Managers  at  all  levels  have  no  problem  discussing  program 
status,  since  the  Criteria  provides  a  vocabulary  and  a 
control  system  which  is  understood  by  all  parties  involved 
in  the  acquisition  process. 

The  contractors  are  in  strong  agreement  when  it  comes 
to  the  primary  advantages  of  the  C/SCSC:  formalized 
forward  planning,  budgeting  discipline,  and  better 
communications. 

There  is  less  agreement  among  the  contractors  on  the 
limitations  of  the  C/SCSC  as  opposed  to  almost  total  con- 
gruity  toward  the  major  advantages.  The  contractors  were 
asked  to  give  the  top  problem  encountered  with  the  C/SCSC, 
and  their  replies  varied  between  the  following  three  areas: 
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1.  Validation  team  C/SCSC  interpretations, 

2.  Required  system  documentation, 

3.  Work  breakdown  structure  (WBS). 

Validation  team  interpretations  of  the  C/SCSC  during 
the  implementation  phase  has  been  very  controversial  with  4 
of  the  5  sampled  contractors.  The  contractors  feel  C/SCSC 
is  a  set  of  criteria  which  their  internal  management  system 
must  satisfy,  and  not  a  specific  system  with  which  a 
validation  team  forces  them  to  comply.  Validation  team 
inflexibility,  coupled  with  the  varied  experience  level  of 
the  team  members,  has  been  detrimental  to  the  objectives 
and  outcome  of  implementation.  Of  course,  the  degree  of 
resistance  depends  on  the  company's  past  management  philo- 
sophy and  practices  and  the  level  of  rigidity  emanating 
from  the  validation  team.  In  rare  instances,  the  company's 
existing  management  control  system  is  in  close  agreement 
with  the  criteria,  consequently  creating  little  or  no 
friction  between  the  contractor  and  the  government.  In 
summary,  the  degree  of  difficulty  experienced  by  a  con- 
tractor transitioning  to  the  C/SCSC  is  related  to  the 
complexity  of  the  existing  system  and  the  interpretations 
of  the  validation  team. 

Additional  frustration  can  surface  on  subsequent 
application  reviews  (3AR).  One  contractor  had  recently 
been  awarded  a  production  contract  by  a  different  military 
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service  than  the  one  who  was  currently  administering 
another  contract  at  the  same  plant.  The  subsequent  appli- 
cation review  team  was  very  flexible  in  its  interpretation 
of  the  C/SCSC,  affording  the  contractor  greater  latitude  in 
controlling  the  new  program.  The  contractor  resented  the 
fact  that  such  a  differential  could  exist  between  different 
review  teams'  interpretation  of  the  same  criteria. 

The  voluminous  documentation  requirements  of  validated 
systems  are  questioned  as  to  their  cost  effectiveness  in 
meeting  the  objectives  of  the  C/SCSC.  The  following 
summary  of  monthly  documentation  volume,  extrapolated 
across  the  total  estimated  number  of  industry  applications, 
gives  an  indication  of  the  order  of  magnitude  [Ref.  2]. 


16,206  pages  . 

1 , 056, 000  pages 

1 ,288,000  pages 

214,485  pages 

161,923  pages 

2,116  pages 


1 .  Customer  reports 

2.  Cost  account  documents 

3.  Work  package  documents 

4.  Schedule  documents 

5.  Routine  estimate  documents 

6.  System  review  reports 
The  total  equates  to  2,738,730  pages  per  month  and 
32,864,760  pages  on  an  annual  basis.  Paper  work  volume  is 
directly  proportional  to  the  number  of  cost  isolations 
created  by  the  contractor's  particular  C/SCSC  application. 
The  number  of  cost  isolations  is  driven  by  contract 
requirements,   individual  contractor   techniques,   and   the 
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interpretation  of  system  requirements  by  the  validation 
team.  The  depth  of  each  cost  isolation  element  is  contin- 
gent upon  the  procedural  interpretations  and  particular 
visibility  desired  by  the  government.  The  depth  can  vary 
considerably  on  future  applications  depending  on  the 
contract  scope  and  the  military  service  conducting  the 
subsequent  application  review. 

The  WBS  is  not  the  normal  method  of  management  control 
in  industry.  A  functional  breakdown  is  utilized  in  order 
for  specific  departments  or  functions  to  be  directly 
responsible  for  their  cost/profit  centers.  This  factor  is 
not  accomplished  with  the  hardware  oriented  WBS;  since,  it 
usually  crosses  multi-functional  lines.  Commercial  enter- 
prises stress  unit  cost  information;  whereas,  the  govern- 
ment requires  system  level  information  for  total  program 
visibility.  The  C/SCSC  forced  contractors  to  convert  to 
the  WBS,  and  many  of  them  have  encountered  difficulty  in 
changing  their  approach  to  doing  business.  A  large  portion 
of  the  firms  have  used  a  matrix  approach  to  accommodate  the 
WBS  orientation  into  their  functional  organizational 
structure.  This  has  been  accomplished  by  assigning  sole 
responsibility  for  each  work  package  to  a  specific  organ- 
izational element.  Military  Standard  88 1  A  (MIL-STD-88 1A) , 
as  interpreted  by  validation  teams,  requires  contractors  to 
drive  the  cost  account  levels  further  down  the  WBS  than  is 
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deemed  practical.  In  addition,  the  validation  teams  have 
displayed  inflexibility  to  the  functional  orientation  of 
the  companies.  These  factors  have  combined  to  substan- 
tially increase  costs  to  the  government  due  to  their 
inherent  inefficiencies. 

Several  additional  limitations  were  addressed  during 
contractor  discussions.  The  Cost  Performance  Report  (CPR) 
which  is  the  required  reporting  instrument,  is  lacking  in 
several  areas.  Managers  are  not  utilizing  the  report, 
because  it  lacks  the  timeliness  and  scope  of  information 
required  to  run  their  area(s)  of  responsibility.  The 
formal  CPR  is  submitted  to  the  government  on  the  average  of 
one  month  after  the  reporting  period.  The  company's 
internal  CPR  utilized  for  actual  management  information 
usually  takes  one  week  to  develop.  Actually,  contractor 
identification  of  problems  occurs  as  a  result  of  daily 
contact  with  the  in-process  effort,  and  not  by  the  monthly 
CPR.  The  CPR  benefits  the  contractor  only  to  the  extent  of 
quantifying  the  cost  impact  of  previously  known  problems. 
The  time  factor  for  the  internal  CPR  is  dependent  on  how 
the  data  formats  are  generated.  Some  companies  manually 
prepare  their  CPR.  The  majority  of  contractors  utilize  a 
combination  of  manual  and  computer  prepared  data  formats. 
The  formal  CPR  is  further  delayed  due  to  the  requirement 
for  a  detailed  explanation  of  all  cost  and  schedule 
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variances  which  exceed  predetermined  thresholds.  Explana- 
tions of  variances  must  clearly  identify  the  nature  of  the 
problem,  the  reasons  for  the  cost  or  schedule  variance,  the 
impact  on  the  immediate  task,  the  impact  on  the  total 
program,  and  the  corrective  action  to  be  taken  by  the  con- 
tractor. Cost  variance  should  identify  amounts  attributa- 
ble to  rate  changes  separately  from  amounts  applicable  to 
manhours.  The  specific  variances  must  be  explained  as 
follows  : 

1.  Schedule  variances  (budgeted  cost  for  work 
scheduled  vs  budgeted  cost  for  work  performed); 

2.  Cost  variances  (actual  cost  for  work  performed  vs 
budgeted  cost  for  work  performed); 

3.  Cost  variance  at  completion  (budgeted  at  completion 
vs  latest  revised  estimate  at  completion) . 

In  addition  to  the  above  variance  explanation,  the 
following  analyses  are  mandatory  [Ref.  91* 

1.  Identify  the  effort  to  which  the  undistributed 
budget  applies  ; 

2.  Identify  the  amount  of  management  reserve  applied 
during  the  reporting  period,  the  WBS  elements  to 
which  applied,  and  the  reasons  for  application. 

One  can  imagine  the  enormity  of  this  task  if  a  large  amount 
of  cost  accounts  are  over  the  variance  reporting  thres- 
holds.  Predetermined  thresholds  vary  among  the  different 
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applications  of  C/SCSC,  but  a  variance  range  of  10-15%  is 
quite  common. 

The  rigidity  of  the  C/SCSC  and  its  interpretation  by 
government  personnel  does  not  allow  the  desired  contractor 
flexibility  in  rebudgeting  open  work.  Many  contractors 
initially  budget  their  work  packages  and  resultant  cost 
accounting  very  conservatively,  in  order  to  incentivize 
their  workers  to  achieve  greater  efficiencies.  This 
methodology  has  some  degree  of  success  in  attaining  the 
desired  results,  but  generally  the  outcome  is  a  substantial 
number  of  cost  accounts  over  threshold.  The  average  C/SCSC 
application  has  over  600  cost  accounts  with  individual 
firms  in  the  population  having  as  low  as  50  and  as  high  as 
6,700  [Ref.  2].  The-  amount  of  time  required  to  document 
only  10*  of  the  average  total  number  of  cost  accounts, 
which  possess  an  adverse  variance,  is  a  substantial  task. 
This  documentation,  coupled  with  its  additive  time  effect 
on  subsequent  monthly  CPR's,  produces  a  late  product. 
Since  the  CPR  provides  only  summary  level  data,  its 
usefulness  is  relegated  to  upper  level  management  for 
overall  program  visibility.  Lower  level  managers  require 
additional  reports  to  satisfy  their  need  for  information 
below  this  summary  level. 

A  thorough  understanding  of  the   significance  of 
schedule  variance  data  on  the  CPR  is  lacking.   Unlike  cost 
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variance,  which  is  a  very  clear  and  substantive  indicator 
of  performance,  schedule  variance  is  quite  vague  in  its 
apparent  aggregate  meaning  to  a  program.  Contractors 
employ  various  methods  to  schedule  their  work,  since  the 
C/SCSC  is  silent  on  specific  guidance.  Activity  scheduling 
(start/end  Gantt  type)  and  milestone  scheduling  are  the 
most  widely  utilized  techniques.  In  many  instances,  they 
are  used  in  conjunction  with  each  other.  Critical  path 
techniques  are  utililzed  by  only  one  third  of  the  firms. 
Contractor's  use  of  a  deterministic  rather  than  a  proba- 
bilistic scheduling  approach  results  in  schedules  which  are 
overly  optimistic.  A  high  level  of  confidence  does  not 
exist  in  the  scheduling  process  due  to  the  lack  of  a  fully 
integrated  probabilistic  networking  approach  [Ref.  11]. 
The  general  lack  of  sophistication  and  capability  in  the 
scheduling  methodologies  produces  schedule  variances  which 
are  deficient  in  their  relative  impact  to  the  overall 
program.  The  relative  impact  of  a  particular  delay  or 
series  of  delays  can  only  be  achieved  through  the  use  of  a 
sophisticated  networking  procedure. 

The  technical  significance  of  a  particular  cost  vari- 
ance has  also  been  a  problem.  Cost  performance  measurement 
is  more  of  an  indicator  of  success  or  failure  in  the 
estimating  effort  rather  than  a  true  measure  of  technical 
accomplishment.    The  author  contends  that  measuring 
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progress  of  technical  performance  requires  a  thorough 
understanding  and  involvement  of  personnel  in  the  engineer- 
ing effort.  Their  on-site  assessments  of  variances  are  a 
necessity  for  proper  problem  analysis.  The  manager  can  not 
afford  to  stay  in  the  vacuum  of  a  C/SCSC  report  and  expect 
to  attain  a  realistic  picture  of  what  is  transpiring  on  a 
program. 

Misconceptions  have  developed  in  the  government's 
analysis  of  CPR  data.  One  of  the  largest  problems  becomes 
apparent  when  historical  comparisons  are  attempted  between 
different  contractors  and/or  programs.  Costs  on  the  CPR 
can  vary  greatly  depending  on  the  way  earned  value  is 
calculated,  how  the  work  was  planned,  the  level  and  manner 
which  overhead  is  collected,  and  the  procedures  applied  in 
the  particular  accounting  system.  For  those  reasons,  it 
can  be  misleading  to  try  and  make  meaningful  analogies. 
The  government  persists  in  developing  comparisons  even 
though  their  true  value  is  suspect. 

It  is  crucial  for  the  use  of  management  reserve  (MR)  to 
be  fully  understood  by  the  government.  MR  usage  depends  a 
great  deal  on  the  individual  management  philosophy  which 
varies  among  contractors.  In  many  cases,  MR's  are  usually 
held  at  a  summary  level  and  controlled  by  the  project 
manager,  while  others  provide  reserves  to  individual 
functional  managers.   Some  managers  use  the  reserve  as  the 
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problems  develop,  while  others  prefer  to  show  the  cost 
variances  and  simply  maintain  the  reserve  as  a  kind  of 
balancing  account  at  the  summary  level.  If  the  latter 
method  is  exercised,  one  must  be  very  alert  to  the  total 
unallocated  management  reserve  and  the  magnitude  of  the 
cost  variance.  In  many  instances,  the  total  cost  variance 
unknowingly  creeps  above  the  remaining  MR,  and  the  actual 
cost  status  is  misjudged. 

The  90  day  requirement,  after  contract  award,  for  the 
contractor  to  be  prepared  to  demonstrate  the  operation  of 
its  C/SCSC  system  is  deemed  unrealistic.  In  fact,  two- 
thirds  of  all  formal  reviews  occur  200  days  beyond  contract 
award  [Ref.  2]. 

The  principal  reason  for  the  delay  is  the  massive 
amount  of  planning  and  documentation  necessary  to  stabilize 
and  to  expose  the  system  to  review.  The  massive  effort 
originated  from  the  shear  volume  of  cost  isolations  exper- 
ienced by  the  firms.  Another  prevalent  reason  is  the 
impact  of  having  the  C/SCSC  forced  upon  the  corporation. 
The  organization  has  an  existing  equilibrium  of  personal, 
political,  and  cognitive  factors,  which  are  disturbed  by 
the  introduction  of  the  C/SCSC.  There  is  resistance  to 
change,  a  reasonable  response  from  members  of  an  existing 
system  in  steady  state.  Those  individuals  want  to  avoid 
the  upheaval,  the  effort,  and  the  envisioned  risks  brought 
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about  by  change.  The  organization  can  also  be  described  in 
terms  of  coalitions;  each  of  which  has  its  own  goals, 
priorities,  and  focus  of  attention.  These  coalitions  will 
likewise  be  threatened  by  change.  They  do  not  feel  a  need 
for  the  C/SCSC;  therefore,  resistance  to  change  is  hard  to 
overcome.  Sincere,  top  level  management  support  provides 
the  most  incentive  for  organizational  momentum  toward 
successful  implementation. 

The  cost  effectiveness  of  the  C/SCSC  is  hard  to  quan- 
tify. The  author  did  not  attempt  a  full  cost/benefit 
analysis  of  the  C/SCSC  applications  due  to  time  and 
required  data  base  constraints.  Contractors  were  asked  to 
give  their  best  estimate  of  the  cost  savings  which  might 
accrue  from  a  less  rigorous  system,  such  as  the  C/-3SR.  The 
potential  cost  savings  ranged  from  1/2 -2  %  per  contract. 
This  cost  savings  is  quite  significant,  since  only  a  single 
$100  million  contract  could  save  anywhere  from  $.5-2.0 
million.  The  entire  DOD  Procurement  and  Research,  Develop- 
ment, Test  and  Evaluation  (RDT&E)  budgets  are  approaching 
$100  billion,  and  the  C/SCSC  has  a  bearing  on  a  large  por- 
tion of  that  total.  The  total  savings  to  the  government  by 
going  to  the  C/SSR  concept  could  conservatively  reach 
several  hundred  million  dollars  a  year.  The  DOD  could  pur- 
chase much  needed  additional  hardware  with  these  savings. 
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It  becomes  the  nebulous  task  of  attempting  to  assign  a 
utility  value  to  the  stringent  C/SCSC  requirements. 

Is  the  federal  government  getting  its  money's  worth  out 
of  the  C/SCSC?  The  author  could  not  find  any  literature 
where  a  quantified  approach  had  been  attempted  to  ascertain 
the  utility  of  the  C/SCSC.  Since  government  opinions  were 
not  within  the  purview  of  this  study,  contractor  usage  of 
the  C/SCSC  on  a  non-contractual  basis  could  be  an  indicator 
of  its  relative  utility.  The  author  feels  that  profit 
motivation  dictates  contractors  will  attempt  to  use  the 
most  cost  effective  management  control  system  consistent 
with  the  desired  amount  of  control.  Contractors  inter- 
viewed never  use  the  full  C/SCSC  requirements  unless 
contractually  required.  However,  many  large  contracts 
utilize  a  less  detailed  and  costly  version  of  the  C/SCSC, 
which  is  closer  to  the  C/SSR.  Cost  isolations  are  greatly 
reduced,  and  the  reporting  system  is  modified  to  be  more 
responsive.  The  monthly  cost / schedule  cycle  is  not 
frequent  enough  for  internal  trend  analysis  of  costs.  They 
are  tracked  weekly  at  higher  levels  than  demanded  by  the 
C/SCSC.  In  summary,  there  are  good  indications  that  the 
full  C/SCSC  requirements  are  not  optimally  cost  effective 
as  evidenced  by  the  following: 

1.  Low  contractor  perceived  utility  of  the  full  C/SCSC 
requirements,  and 
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2.   High  cost  differential  between  the  stringent  C/SCSC 
requirements  and  a  less  rigorous  system,  such  as 
the  C/SSR. 
The  next  chapter  will  provide  the  author's  conclusions 
and  recommendations. 
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IV.   CONCLUSIONS  AND  RECOMMENDATIONS 

This  chapter  will  provide  a  summary  of  the  significant 
conclusions  and  recommendations  gleaned  from  the  author's 
examination  of  five  validated  C/SCSC  contractors. 

A.   CONCLUSIONS 

1 .  The  contractors  who  participated  in  this  study  do 
not  feel  the  original  objectives  of  the  C/SCSC  have  been 
fulfilled.  Although  some  aspects  of  the  C/SCSC,  such  as 
formalized  forward  planning,  budgeting  discipline,  and 
better  communications,  were  considered  beneficial;  the 
rigidity  of  the  system  was  deemed  an  overriding  weakness. 
Contractors  interpreted  the  C/SCSC  as  a  framework  in  which 
they  could  flexibly  modify  their  existing  system  to  satisfy 
the  Criteria.  Instead  of  a  stable  set  of  criteria  which 
their  internal  management  system  must  satisfy,  contractors 
have  experienced  the  evolution  of  a  myriad  of  detailed 
guidance.  To  further  exasperate  the  situation,  government 
review  teams  have  forced  them  to  comply  with  specific 
interpretations  of  the  Criteria.  Continuity  is  lacking 
between  validation  teams,  and  the  level  of  expertise  also 
varies  among  the  individual  components  of  the  teams.  Many 
contractors,  who  were  optimistic  prior  to  the  implementa- 
tion process,  became  frustrated  and  possessed  more  interest 
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in  achieving  validation  states  than  modifying  their 
existing  systems  in  a  useful  manner.  Their  general  atti- 
tude toward  the  C/SCSC  concept  was  directly  proportional  to 
the  degree  of  difficulty  encountered  during  the  implementa- 
tion process. 

2.  The  voluminous  documentation  requirements  of  the 
C/SCSC  are  questioned  by  the  contractors  as  to  their  cost 
effectiveness .  The  depth  of  the  cost  isolations  dictates 
the  amount  of  paper  work  produced  by  the  contractor.  The 
procedural  interpretations  and  visibility  desired  by  the 
particular  validation  team  determines  this  depth.  Where  is 
the  utility  in  driving  cost  centers  to  such  unreasonably 
low  levels?  It  is  estimated  that  the  average  monthly 
documentation  Volume  for  all  industry  C/SCSC  applications 
is  2,738,730  pages.  This  astonishing  figure  equates  to 
32,864,760  pages  per  year  [Ref.  2]. 

3.  The  cost  effectiveness  of  utilizing  the  C/SCSC  in 
its  present  form  is  suspect.  Contractors  interviewed  never 
employ  the  full  C/SCSC  unless  contractually  required.  A 
modified  version  is  utilized  on  some  large  contracts,  but 
the  cost  isolations  are  reduced,  and  the  reporting  system 
changed  to  increase  responsiveness.  Internal  trend 
analysis  is  performed  on  a  weekly  basis  at  higher  levels 
than  demanded  by  the  C/SCSC.  Contractors  indicated  a 
potential  1/2-2%  savings  could  be  realized  by  employing  a 
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less  rigorous  system,  such  as  the  C/3SR.  The  government 
could  conceivably  accrue  a  several  hundred  million  dollar 
savings  per  year  by  applying  this  concept. 

4.  Contractor  responses  to  this  study  leave  doubt  to 
the  value  of  the  strict  procedural izat ion ,  detail,  and 
documentation  currently  being  demanded  of  accepted  systems. 
It  is  felt  a  consistent,  less  rigid  interpretation  of  the 
Criteria  would  provide  an  adequate  basis  for  responsible 
decision  making.  At  the  same  time,  the  Criteria  would 
furnish  a  more  cost  effective  mode  of  doing  business.  Of 
course,  this  contractor  viewpoint  is  made  under  the 
assumption  the  C/SCSC  is  firmly  entrenched,  and  it  will 
remain  a  viable  requirement.  Philosophically,  contractors 
question  why  the  government,  in  concern  for  a  product, 
spends  so  much  time,  money,  and  other  resources  for 
regulatory  control.  The  only  true  value  to  the  government, 
as  perceived  by  industry,  is  possibly  for  historical  data 
purposes.  It  is  highly  questionable,  considering  the 
costs,  whether  the  government  is  justified  in  forcing 
compliance  with  the  C/SCSC  solely  for  that  reason. 

5.  The  C/SCSC  is  counterproductive,  and  it  fails  to 
recognize  the  substantial  improvement  in  the  quality  of 
industry  management  practices  of  the  last  two  decades . 
Many  firms  feel  the  C/SCSC  is  in  conflict  with  the  current 
national  policy  of  streamlining  the  acquisition  process, 
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and  the  task  of  advancing  the  management  state  of  art 
should  be  left  to  the  more  efficient  competitive 
marketplace  . 

B.   RECOMMENDATIONS 

The  conclusions  of  this  study  were  drawn  from  an 
extremely  small  sample  of  the  defense  industry.  It  would 
be  presumptuous  to  recommand  broad  changes  to  the  C/SCSC 
based  on  the  limited  extent  of  the  sample.  Nevertheless, 
there  was  great  conformity  among  many  of  the  opinions 
expressed  during  the  study.  This  trend  supports  these 
viewpoints  as  symptoms  of  industry  as  a  whole.  The 
following  recommendations  are  considered  to  be  the  most 
reasonable  approach  for  further  investigation  and  probable 
improvement  of  the  C/SCSC: 

1.  Determine  the  actual  cost  effectiveness  of  the 
C/SCSC.  Has  the  C/SCSC  appreciably  lowered  the 
cost  overruns  and  late  deliveries  on  major  weapon 
system  acquisitions  and  by  how  much?  Is  the  level 
of  utility  worth  the  high  price  being  paid  for  the 
C/SCSC?  A  thorough  cost/benefit  analysis  is  long 
overdue,  and  the  results  would  be  very  beneficial 
to  the  future  decision  making  process. 

2.  Contract  value  should  not  necessarily  dictate  the 
inclusion  of  the  C/SCSC  requirements  into  a 
contract.   The  various  Systems  Commands  should  have 
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the  latitude  to  determine  whether  or  not  to  include 
the  C/SCSC  in  a  particular  program. 

3.  The  program  manager  should  have  the  flexibility  to 
tailor  the  C/SCSC  to  meet  program  office  objectives 
and  to  play  the  leading  role  in  the  validation 
process  . 

4.  Every  program  office  should  assure  their  C/SCSC 
personnel  are  thoroughly  trained  and  qualified  to 
perform  their  increased  role  in  the  implementation 
and  subsequent  review  processes. 

These  recommendations  are  not  a  panacea  for  every 
disagreement  encountered  with  the  C/SCSC.  Hopefully,  they 
represent  an  intelligent  approach  at  easing  the  discord 
among  contractors  and  at  helping  to  streamline  the 
acquisition  process. 
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APPENDIX    A 


SUBJECT 

References : 


NUUBUt     7000 » 2 
OATS     Jun«  10,    1977 


Department   of  Defense   Instruction 


ASD(C) 


Performance  .Measurement  for  Selected  Acquisitions 

(a) 
(b) 


(c) 
(d) 


DoD  Directive  7000.1,  "Resource  Management  Systems 
of  the  Department  of  Defense,"  August  22,  1966 

DoO  Directive  5000.1,  "Major  System  Acquisitions," 
January  V8,  1977 

DoO  Directive  5000.2,  "Major  System  Acquisition 
Process,"  January  13,  1977 

through  (i),  see  enclosure  2. 


A.  REISSUANCE  ANO  PURPOSE 

This  Instruction  reissues  reference  (f)  and  sets  forth  objectives  and 
criteria  for  the  application  of  uniform  DoO  requirements  to  selected  de- 
fense contracts.  The  provisions  of  this  Instruction  specifically  require 
the  use  of  Cost/Schedule  Control  Systems  Criteria  (C/SCSC)  in  selected 
acquisitions.  Reference  (f)  is  hereby  superseded  and  cancelled. 

B.  APPLICABILITY  AND  SCOPE 

1.  The  provisions  of  this  Instruction  apply  to  all  Military  Depart- 
ments and  Defense  Agencies  (hereafter  referred  to  as  "DoD  Components")  which 
are  responsible  for  acquisitions  during  systems  development  and  production. 

2.  The  acquisitions  governed  by  this  Instruction  are  in  selected  con- 
tracts and  subcontracts  within  programs  designated  as  major  system  acquisi- 
tion programs  in  accordance  with  reference  (b).     Firm- fixed-price  and  firm- 
fixed-price-with-economic-price-adjustment  contracts  are  excluded.     Appli- 
cation of  the  C/SCSC  to  major  construction  projects  is  also  encouraged  where 
appropriate. 

C.  OBJECTIVES 

1.  To  provide  an  adequate  basis  for  responsible  decision-making  by 
both  contractor  management  and  DoO  Components,  contractors'  internal  man- 
agement control  systems  must  provide  data  which  (a)  indicate  work  progress, 
(b)  properly  relate  cost,  schedule  and  technical  accomplishment,  (c)  are 
valid,  timely  and  auditable,  and  (d)  supply  OoO  managers  with  Information 
at  a  practicable  level  of  summarization. 

»2.  To  bring  to  the  attention  of,  and  encourage,  DoO  contractors  to 
accept  and  install  management  control  systems  and  procedures  which  are 
most  effective  in  meeting  their  requirements  and  controlling  contract  per- 
formance. DoO  contractors  also  should  be  continuously  alert  to  advances 
in  management  control  systems  which  will  improve  their  internal  operations. 
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D.  POLICY 

1.  It  shall  be  the  general  policy  to  (a)  require  applications  of  the 
C/SC3C  as  stated  in  enclosure  1  to  programs  that  are  within  the  scope  of 
section  3.,  above,  (b)  require  no  changes  1n  contractors'  existing  cost/ 
schedule  control  systems  except  those  necessary  to  meet  the  C/SCSC,  and 

(c)  require  the  contractor  to  provide  to  the  Government  performance  data 
directly  from  the  same  system  used  for  internal  management. 

2.  The  policies  and  criteria  contained  herein  will  not  be  construed  as 
requiring  the  use  of  specific  systems  or  changes  in  accounting  systems 
which  will  adversely  affect  (a)  the  equitable  distribution  of  costs  to  all 
contracts,  or  (b)  compliance  with  the  standards,  rules,  and  regulations 
promulgated  by  the  Cost  Accounting  Standards  Board. 

3.  Subcontracts  within  applicable  programs,  excluding  those  that  are 
firm-fixed-price,  may  be  selected  for  application  of  these  criteria  by 
mutual  agreement  between  prime  contractors  and  the  contracting  OoO  Compo- 
nent, according  to  the  critical ity  of  the  subcontract  to  the  program. 
Coverage  of  certain  critical  subcontracts  may  be  directed  by  the  Depart- 
ment of  Defense,  subject  to  the  changes  article  of  the  contracts.  In 
those  cases  where  a  subcontractor  is  not  required  to  comply  with  the  cri- 
teria, the  Cost/Schedule  Status  Report  (C/SSR)  approach  to  performance 
measurement  set  forth  in  DoD  Instruction  7000.10  (reference  (g))  will 
normally  be  used.  The  limitations  in  reference  (g)  apply. 

4.  The  applicability  of  C/SCSC  and  provisions  concerning  the  accept- 
ability and  use  of  contractor's  cost/schedule  control  systems  shall  be 
(a)  included  in  the  Decision  Coordinating  Papers  (DCP)  leading  to  the 
decisions  for  full-scale  development  and  production,  (b)  addressed  in 
procurement  plans,  (c)  set  forth  in  Requests  for  Proposal  (RFP),  and 

(d)  made  a  contractual  requirement  1n  appropriate  procurements. 

a.  Reviews  of  Systems.  To  ensure  compliance  with  the  Cost/ 
Schedule  Control  Systems  Criteria,  contractors'  systems  will  be  reviewed 
during  various  phases  of  the  contracting  process...      "• 

(1)  Where  the  C/SCSC  are  included  as  a  requirement  in  the  RF?, 
an  Evaluation  Review  will  be  performed  as  an  integral  part  of  the  source 
selection  process. 

(2)  After  contract  award,  an  1n-plant  Demonstration  Review 
will  be  made  to  verify  that  the  contractor  is  operating  systems  which 
meet  the  criteria. 

(3)  Upon  successful  completion  of  the  Demonstration  Review, 
contractors  will  not  be  subjected  to  another  Demonstration  Review  unless 
there  are  positive  indications  that  the  contractor's  systems  no  longer 
operate  so  as  to  meet  the  criteria. 
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7000.2 
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(4)  Subsequent  contracts  may  require  a  review  of  shorter  dura- 
tion and  less  depth  to  ensure  the  appropriate  and  effective  application  of 
the  accepted  systems  to  the  new  contract. 

(5)  Detailed  procedures  relating  to  contractual  application, 
interpretative  guidance,  interservice  relationships,  and  conduct  of  sys- 
tems reviews  are  contained  in  the  Cost/Schedule  Control  Systems  Criteria 
Joint  Implementation  Guide  (reference  (h)). 

b.  Memorandum  of  Understanding.  After  determination  that  a  man- 
agement system  meets  C/SCSC,  a  Memorandum  of  Understanding  may  be  estab- 
lished between  the  Department  of  Defense  and  the  contractor  to  apply  to 
future  contracts. 

(1)  The  use  of  a  Memorandum  of  Understanding  contemplates  the 
execution  of  a  written  instrument  which  references  the  C/SCSC  and  nego- 
tiated provisions  which  (a)  reflect  an  understanding  between  the  contractor 
and  the  DoO  of  the  requirements  of  the  DoD  criteria,  and  (b)  identify  the 
specific  system(s)  which  the  contractor  intends  to  use  on  applicable  con- 
tracts with  DoO  Components. 

(2)  The  Memorandum  of  Understanding  will  include  or  make  ref- 
erence to  a  written  description  of  the  system(s)  accepted  in  a  Demonstra- 
tion Review.  The  system  description  should  be  of  sufficient  detail  to 
permit  adequate  surveillance  by  responsible  parties.  The  use -of  a  Memo- 
randum of  Understanding  is  preferred  where  a  number  of  separate  contracts 
between  one  or  more  DoD  Component(s)  and  the  contractor  may  be  entered 
into  during  the  term  of  the  Memorandum  of  Understanding.  It  contemplates 
the  delegation  of  authority  to  the  DoD  Component  negotiating  the  Memoran- 
dum of  Understanding  with  the  contractor  to  make  the  agreement  on  behalf 
of  all  prospective  DoD  contracting  components. 

(3)  Action  to  develop  a  Memorandum  of  Understanding  may  be 
initiated  by  either  the  contractor  or  the  DoO  Component,  but  will  usually 
be  in  connection  with  a  contractual  requirement.  In  a  proposal,  reference 
to  a  Memorandum  of  Understanding  satisfies  the  C/5CSC  requirement  in  RFP's 
and  normally  obviates  the  need  for  further  Evaluation  Review  during  source 
selection.  Procedures  for  executing  Memorandums  of  Understanding  are  in- 
cluded in  the  Cost/Schedule  Control  Systems  Criteria  Joint  Implementation 
Guide  (reference  (h)). 

c.  Surveillance.  Recurring  evaluations  of  the  effectiveness  of 
the  contractor's  policies  and  procedures  will  be  performed  to  ensure  that 
the  contractor's  system  continues  to  meet  the  C/SCSC  and  provides  valid 
data  consistent  with  the  intent  of  this  Instruction.  Surveillance  reviews 
wi\]  be  based  on  selective  tests  of  reported  data  and  periodic  evaluations 
of  internal  practices  during  the  life  of  the  contract.  Guidance  for  sur- 
veillance 1s  set  forth  1n  the  C/SCSC  Joint  Surveillance  Guide  (ref- 
erence (i)). 
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E.     RESPONSIBILITIES 

Pursuant  to  authority  contained  in  DoO  Directive  7000.1   (reference  (a)) 

policy  gu^nirS^ 

and  .ill  .cnitor  their  taJlSJKtlo      o     nsurl    Snsis enTlolic^T3 

througnout  the  Department  of  Defense.  consistent  application 

m^*3'     P1*  Join|  Logistics  Commanders  will  develop  and  issue  ioint  ,-m„ifl 

sussnars  sways.""* *■  >™^  ™  ssjits- 

F-  EFFECTIVE  DATE  AND  IMPLEMENTATION 


— n3*U-^    7*? 


^t/auesfZ/is 


Assistant  Secretary  of  Defense 
(Comptroller) 


Enclosures  -  2 

1.  Cost/Schedule  Control  Systems  Criteria 

2.  List  of  additional   references 
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CQST/SCHSDULS  CONTROL  SYSTEMS  CRITERIA 


1 .  GENERAL 


a.  Any  system  used  by  the  contractor  in  planning  and  controlling  the 
performance  of  the  contract  shall  meet  the  criteria  set  forth  1n  para- 
graph 3.,  below.  Nothing  in  these  criteria  is  intended  to  affect  the 
basis  on  which  costs  are  reimbursed  and  progress  payments  are  made,  and 
nothing  herein  will  be  construed  as  requiring  the  use  of  any  single  sys- 
tem, or  specific  method  of  management  control  or  evaluation  of  performance. 
The  contractor's  internal  systems  need  not  be  changed,  provided  they  sat- 
isfy these  criteria. 

b.  An  element  in  the  evaluation  of  proposals  will  be  the  proposer's 
system  for  planning  and  controlling  contract  performance.  The  proposer 
will  fully  describe  the  system  to  be  used.  The  prospective  contractor's 
cost/schedule  control  system  proposal  will  be  evaluated  to  determine  if 

it  meets  these  criteria.  The  prospective  contractor  will  agree  to  operate 
a  compliant  system  throughout  the  period  of  contract  performance  if  awarded 
the  contract.  The  DoO  will  agree  to  rely  on  the  contractor's  compliant 
system  and  therefore  will  not  impose  a  separata  planning  and  control 
system. 

2.  DEFINITIONS 

a.  ACTUAL  COST  OF  WORK  PERFORMED  (AOIP).  The  costs  actually  incur- 
red and  recorded  in  accompli sning  the  worx  performed  within  a  given 
time  period. 

b.  ACTUAL  DIRECT  COSTS.  Those  costs  identified  specifically  with  a 
contract,  based  upon  the  contractor's  cost  identification  and  accumula- 
tion system  as  accepted  by  the  cognizant  DCAA  representatives.  (See 
Direct  Costs.) 


c.  ALLOCATED  3UDGST.  (See  Total  Allocated  Budget.) 

d.  APPLIED  DIRECT  COSTS.  .Jhe  amounts  recognized  in  the  time  period 
associated  with  the  consumption  of  labor,  material,  and  other  direct 
resources,  without  regard  to  the  date  of  commitment  or  the  date  of 
payment.  These  amounts  are  to  be  charged  to  work-in-process  1n  the  time 
period  that  any  one  of  the  following  takes  place: 

(1)  When  labor,  material  and  other  direct  resources  are  actually 
consumed,  or 

(2)  When  material  resources  are  withdrawn  from  inventory  for 
use*i  or 

(3)  When  material  resources  are  received  that  are  uniquely 
identified  to  the  contract  and  scheduled  for  use  within  50  days,  or 
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(4)  When  major  components  or  assemblies  are  received  on  a  line 
flow  basis  that  are  specifically  and  uniquely  identified  to  a  single 
serially  numbered  end  item. 

e.  APPORTIONED  EFFORT.  Effort  that  by  itself  is  not  readily  divisible 
into  shcrt-span  work  packages  but  which  is  related  in  direct  proportion 

to  measured  effort. 

f.  AUTHORIZED  WORK.  That  effort  whicn  has  been  definitized  and  is 
on  contract,  plus  that  for  which  definitized  contract  costs  have  not 
been  agreed  to  but  for  which  written  authorization  has  been  received. 

g.  BASELINE.  (See  Performance  Measurement  Baseline.) 

h.  BUDGETED  COST  FOR  WORK  PERFORMED  (BCWP) ,  The  sum  of  the  budgets 
for  completed  work  packages  and  completed  portions  of  open  work  packages, 
plus  the  appropriate  portion  of  the  budgets  for  level  of  effort  and 
apportioned  effort. 

i.  BUDGETED  COST  FOR  WORK  SCHEDULED  (BCWS).  The  sum  of  budgets  for 
all  work  packages,  planning  packages,  etc.,  scheduled  to  be  accomplished 
(including  in-process  work  packages),  plus  the  amount  of  level  of  effort 
and  apportioned  effort  scheduled  to  be  accomplished  within  a  given  time 
period. 

j.  3UDGSTS  FOR  WORK  PACKAGES.  (See  Work  Package  3udgets.> 

k.  CONTRACT  3U0GET  3ASE.  The  negotiated  contract  cost  plus  the 
estimated  cost  of  authorized  unpriced  work. 

1.  CONTRACTOR .  An  entity  in  private  industry  which  enters  into 
contracts  with  the  Government.  In  this  Instruction,  the  word  may  also 
apply  to  Government-owned,  Government-operated  activities  which  perform 
work  on  major  defense  programs. 

m.  COST  ACCOUNT.  A  management  control"  point  at  which,  actual  costs 
can  be  accumulated  and  compared  to  budgeted  costs,  for  work  performed.  A 
cost  account  is  a  natural  control  point  for  cost/schedule  planning  and 
control,  since  it  represents  the  work  assigned  to  one  responsible  organi- 
zational element  on  one  contract  work  breakdown  structure  (CW8S)  element. 

n.  DIRECT  COSTS.  Any  costs  which  can  be  identified  specifically 
with  a  particular  final  cost  objective.  This  term  is  explained  in  ASPR 
15-202. 

o.  ESTIMATED  COST  AT  COMPLETION  OR  ESTIMATE  AT  COMPLETION  (EAC). 
Actual  direct  costs,  plus  indirect  costs  allocable  to  the  contract,  plus 
the  estimate  of  costs  (direct  and  indirect)  for  authorized  work  remaining. 

p.  INDIRECT  COSTS.  Costs,  which  because  of  their  incurrence  for 
common  or  joint  oojectives,  are  not  readily  subject  to  treatment  as 
direct  costs.  This  term  is  further  defined  in  ASPR  3-701.3  and  ASPR  15-203. 
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q.  INITIAL  3UDGET.  (See  Original  Budget-) 


r.  INTERNAL  REPLANNING.  Replanning  actions  performed  by  the 
contractor  for  remaining  effort  within  the  recognized  total  allocated 
budget. 

s.  LEVEL  OF  EFFORT  (LOE).  Effort  of  a  general  or  supportive  nature 
which  does  not  produce  definite  end  products  or  results. 

t.  MANAGEMENT  RESERVE.  (Synonymous  with  Management  Reserve  Budget). 
An  amount  of  the  total  allocated  budget  withheld  for  management  control 
purposes  rather  than  designated  for  the  accomplishment  of  a  specific 
task  or  set  of  tasks.  It  is  not  a  part  of  the  Performance  Measurement 
Baseline. 

u.  NEGOTIATED  CONTRACT  COST.  The  estimated  cost  negotiated  in  a 
cost-plus-fixed-fee  contract,  or  the  negotiated  contract  target  cost  in 
either  a  fixed-price-incentive  contract  or  a  cost-plus-incentive-fee 
contract. 

v.  ORIGINAL  BUDGET.  The  budget  established  at,  or  near,  the  time 
the  contract  was  signed,  based  on  the  negotiated  contract  cost. 

w.  OVERHEAO.  (See  Indirect  Costs.) 

x.  PERFORMANCE  MEASUREMENT  3ASELINE.  The  time-phased  budget  plan 
against  which  contract  performance  is  measured.  It  is  formed  by  the 
budgets  assigned  to  scheduled  cost  accounts  and  the  applicable  indirect 
budgets.  For  future  effort,  not  planned  to  the  cost  account  level,  the 
performance  measurement  baseline  also  includes  budgets  assigned  to 
higher  level  CWBS  elements,  and  undistributed  budgets.  It  equals  the 
total  allocated  budget  less  management  reserve. 

y.  PERFORMING  ORGANIZATION.  A  defined  unit  within  the  contractor's 
organization  structure,  whicn  applies  the  resources  to  perform  the  work. 

z.  PLANNING  PACKAGE.   A  logical  aggregation  of  work  within  a  cost 
account,  normally  the  far  term  effort,  that  can  be  Identified  and  budgeted 
in  early  baseline  planning,  but  is  not  yet  defined  into  work  packages. 

aa.  PROCURING  ACTIVITY.  The  subordinate  command 'in  which  the  Procur- 
ing Contracting  Office  (PCO)  is  located.  It  may  include  the  program 
office,  related  functional  support  offices,  and  procurement  offices. 
Examples  of  procuring  activities  are  AFSC/ESO,  AFIC/OC-ALC,  DARCOM/MIRA0C0M, 
and  -NMC/NAVAIRSYSCCM. 

bo.  REPLANNING.  (See  Internal  Replanning.) 

cc.  REPROGRAMMING.  Replanning  of  the  effort  remaining  1n  the  contract, 
resulting  in  a  new  budget  allocation  which  exceeds  the  contract  budget 
base. 
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dd.  RESPONSIBLE  ORGANIZATION.  A  defined  unit  within  the  contractor's 
organization  structure  which  is  assigned  responsibility  for  accomplishing 
specific  tasks. 

ee.  SIGNIFICANT  VARIANCES.  Those  differences  between  planned  and 
actual  performance  which  require  further  review,  analysis,  or  action. 
Appropriate  thresholds  should  be  established  as  to  the  magnitude  of 
variances  which  will  require  variance  analysis. 

ff.  TOTAL  ALLOCATED  BUOGET.  The  sum  of  all  budgets  allocated  to 
the  contract.  Total  allocated  budget  consists  of  the  performance  measure- 
ment baseline  and  all  management  reserve.  The  total  allocated  budget 
will  reconcile  directly  to  the  contract  budget  base.  Any  differences 
will  be  documented  as  to  quantity  and  cause. 

gg.  UNDISTRIBUTED  3UDGST.  Budget  applicable  to  contract  effort 
which  has  not  yet  been  identified  to  CVJBS  elements  at  or  below  the 
lowest  level  of  reporting  to  the  Government. 

hh.  VARIANCES.  (See  Significant  Variances.) 

ii.  WOKK  3REAKD0WN  STRUCTURE.  A  product-oriented  family  tree 
division  of  hardware,  software,  services,  and  other  work  tasks  which 
organizes,  defines,  and  graphically  displays  the  product  to  be.  produced, 
as  well  as  the  work  to  be  accomplished  to  achieve  the  specified  product. 

(1)  Project  Summary  Work  Breakdown  Structure.  A  summary  WBS 
tailored  to  a  specific  defense  materiel  item  by  selecting  applicable 
elements  from  one  or  more  summary  WBS's  or  by  adding  equivalent  elements 
unique  to  the  project  (MIL-STD-381A). 

(2)  Contract  Work  Breakdown  Structure  (CVI8S).  The  complete  W8S 
for  a  contract,  developed  and  used  by  a  contractor  within  the  guidelines 
of  MIL-STD-381A,  and  according  to  the  contract  work  statement. 

jj.  WORK  PACKAGE  3U0GETS.  Resources  which  are  formally  assigned  by 
the  contractor  to  accomplish  a  work  package,  expressed  in  dollars, 
hours,  standards,  or  other  definitive  units. 

kk.  WORK  PACKAGES.  Detailed  short-span  jobs,  oe  material  items, 
identified  by  the  contractor  for  accomplishing  work  required  to  complete 
the  contract.  A  work  package  has  the  following  characteristics: 

(1)  It  represents  units  of  work  at  levels  where  work  is  performed. 

(2)  It  1s  clearly  distinguishable  from  all  other  work  packages. 

(3)  It  is  assignable  to  a  single  organizational  element. 

(4)  It  has  scheduled  start  and  completion  dates  and,  as  appli- 
cable, interim  milestones,  all  of  which  are  representative  of  physical 
accomplishment. 
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(5)  It  has  a  budget  or  assigned  value  expressed  in  terms  of 
dollars,  man-hours,  or  other  measurable  units. 

(6)  Its  duration  is  limited  to  a  relatively  short  span  of 
time  or  it  is  subdivided  by  discrete  value-milestones  to  facilitate  the 
objective  measurement  of  work  performed. 

(7)  It  is  integrated  with  detailed  engineering,  manufacturing, 
or  other  schedules. 

3.     CRITERIA 

The  contractors'  management  control  systems  will  include  policies, 
procedures,  and  methods  which  are  designed  to  ensure  that  they  will 
accomplish  the  following: 

a.  Organization 

(1)  Define  all  authorized  work  and  related  resources  to  meet  the 
requirements  of  the  contract,  using  the  framework  of  the  CUBS. 

(2)  Identify  the  internal  organizational  elements  and  the  major 
subcontractors  responsible  for  accomplishing  the  authorized  work. 

(3)  Provide  for  the  integration  of  the  contractor's  planning, 
scheduling,  budgeting,  work  authorization  and  cost  accumulation  systems 
with  each  other,  the  CWBS,  and  the  organizational  structure. 

(4)  Identify  the  managerial  positions  responsible  for  control- 
ling overhead  (indirect  costs). 

(5)  Provide  for  integration  of  the  CWBS  with  the  contractor's 
functional  organizational  structure  in  a  manner  that  permits  cost  and 
schedule  performance  measurement  for  CW8S.and  organizational  elements. 

b.  Planning  and  Budgeting 

(1)  Schedule  the  authorized  work  in  a  manner  which  describes  the 
sequence  of  work  and  identifies  the  significant  task  interdependent es 
required  to  meet  the  development,  production  and  delivery  requirements 
of  the  contract. 

(2)  Identify  physical  products,  milestones,  technical  perform- 
ance goals,  or  other  indicators  that  will  be  used  to  measure  output. 

%.     (3)  Establish  and  maintain  a  time-phased  budget  baseline  at  the 
cost  account  level  against  which  contract  performance  can  be  measured. 
Initial  budgets  established  for  this  purpose  will  be  based  on  the  negoti- 
ated target  cost.  Any  other  amount  used  for  performance  measurement 
purposes  must  be  formally  recognized  by  both  the  contractor  and  the 
Government. 
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(4)  Establish  budgets  for  all  authorized  work  with  separate 
identification  of  cost  elements  (labor,  material,  etc.). 

(5)  To  the  extent  the  authorized  work  can  be  identified  in 
discrete,  short-span  work  packages,  establish  budgets  for  this  work  in 
terms  of  dollars,  hours,  or  other  measurable  units.  Where  the  entire 
cost  account  cannot  be  subdivided  into  detailed  work  packages,  identify 
the  far  term  effort  in  larger  planning  packages  for  budget  and  schedul- 
ing purposes. 

(6)  Provide  that  the  sum  of  all  work  package  budgets, plus  plan- 
ning package  budgets  within  a  cost  account  equals  the  cost  account 
budget. 

(7)  Identify  relationships  of  budgets  or  standards  in  underlying 
work  authorization  systems  to  budgets  for  work  packages. 

(8)  Identify  and  control  level  of  effort  activity  by  time-phased 
budgets  established  for  this  purpose.  Only  that  effort  which  cannot  be 
identifed  as  discrete,  short-span  work  packages  or  as  apportioned  effort 
will  be  classed  as  level  of  effort. 

(9)  Establish  overhead  budgets  for  the  total  costs  of  each 
significant  organizational  component  wnose  expenses  will  become  indirect 
costs.  Reflect  in  the  contract  budgets  at  the  appropriate  level  the 
amounts  in  overhead  pools  that  will  be  allocated  to  the  contract  as 
indirect  costs. 

(10)  Identify  management  reserves  and  undistributed  budget. 

(11)  Provide  that  the  contract  target  cost  plus  the  estimated 
cost  of  authorized  but  unpriced  work  is  reconciled  with  the  sum  of  all 
internal  contract  budgets  and  management  reserves. 

C.  Accounting 

(1)  Record  direct  costs  on  an  applied  or  other  acceptable  basis 
in  a  formal  system  that  is  controlled  by  the  general  books  of  account. 

(2)  Summarize  direct  costs  from  cost  accounts  into  the  WBS 
without  allocation  of  a  single  cost  account  to  two  or  more  WBS  elements. 

(3)  Summarize  direct  costs  from  the  cost  accounts  into  the 
contractor's  functional  organizational  elements  without  allocation  of  a 
single  cost  account  to  two  or  more  organizational  elements. 

(4)  Record  all  indirect  costs  which  will  be  allocated  to  the 
contract. 

(5)  Identify  the  bases  for  allocating  the  cost  of  apportioned 
effort. 
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(6)  Identify  unit  costs,  equivalent  unit  costs,  or  lot  costs  as 
applicable. 

(7)  The  contractor's  material  accounting  system  will  provide 
for: 

(a)  Accurate  cost  accumulation  and  assignment  of  costs  to 
cost  accounts  in  a  manner  consistent  with  the  budgets  using  recognized, 
acceptable  costing  techniques. 

(b)  Determination  of  price  variances  by  comparing  planned 
versus  actual  commitments. 

(c)  Cost  performance  measurement  at  the  point  in  time  most 
suitable  for  the  category  of  material  involved,  but  no  earlier  than  the 
time  of  actual  receipt  of  material. 

(d)  Determination  of  cost  variances  attributable  to  the 
excess  usage  of  material. 

(e)  Determination  of  unit  or  lot  costs  when  applicable. 

(f)  Full  accountability  for  all  material  purchased  for  the 
contract,  including  the  residual  inventory. 

d.  Analysis 


(1)  Identify  at  the  cost  account  level  on  a  monthly  basis  using 
data  from,  or  reconcilable  with,  the  accounting  system: 

(a)  Budgeted  cost  for  work  scheduled  and  budgeted  cost  for 
work  performed. 

(b)  3udgeted  cost  for  work  performed  and  applied  (actual 
where  appropriate)  direct  costs  for  the  same  worJc,' 

(c)  Variances  resulting  from  the  above  comparisons  clas- 
sified in  terms  of  labor,  material,  or  other  appropriate  elements  together 
with  the  reasons  for  significant  variances. 

(2)  Identify  on  a  monthly  basis,  in  the  detail  needed  by  manage- 
ment for  effective  control,  budgeted  indirect  costs,  actual  indirect 
costs,  and  variances  along  with  the  reasons. 

♦-  (3)  Summarize  the  data  elements  and  associated  variances  listed 
1n  (1)  and  (2)  above  through  the  contractor  organization  and  'W3S  to  the 
reportfng  level  specified  in  the  contract. 

(4)  Identify  significant  differences  on  a  monthly  basis  between 
planned  and  actual  schedule  accomplishment  and  the  reasons. 
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(5)  Identify  managerial  actions  taken  as  a  result  of  criteria 
items  (1)  through  (4)  above. 

(6)  Based  on  performance  to  date  and  on  estimates  of  future 
conditions,  develop  revised  estimates  of  cost  at  completion  for  WBS 
elements  identified  in  the  contract  and  compare  these  with  the  contract 
budget  base  and  the  latest  statement  of  funds  requirements  reported  to 
the  Government. 

e.  Revisions  and  Access  to  Data 

(1)  Incorporate  contractual  changes  in  a  timely  manner  recording 
the  effects  of  such  changes  in  budgets  and  schedules.  In  the  directed 
effort  prior  to  negotiation  of  a  change,  base  such  revisions  on  the 
amount  estimated  and  budgeted  to  the  functional  organizations. 

(2)  Reconcile  original  budgets  for  those  elements  of  the  work 
breakdown  structure  identified  as  priced  line  items  in  the  contract,  and 
for  those  elements  at  the  lowest  level  of  the  OoO  Project  Summary  WBS, 
with  current  performance  measurement  budgets  in  terms  of  (a)  changes  to 
the  authorized  work  and  (b)  internal  replanning  in  the  detail  needed  by 
management  for  effective  control. 

(3)  Prohibit  retroactive  changes  to  records  pertaining-  to  work 
performed  that  will  change  previously  reported  amounts  for  direct  costs, 
indirect  costs,  or  budgets,  except  for  correction  of  errors  and  routine 
accounting  adjustments. 

(4)  Prevent  revisions  to  the  contract  budget  base  (paragraph 
2.k.)  except  for  Government  directed  changes  to  contractual  effort. 

(5)  Document,  internally,  changes  to  the  performance  measurement 
baseline  (paragraph  2.x.)  and,  on  a  timely  basis-  notify  the  procuring 
activity  through  prescribed  procedures. 

(6)  Provide  the  contracting  officer  and  his  duly  authorized 
representatives  access  to  all  of  the  foregoing  Information  and  support- 
ing documents. 
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AFSCP  173-5 


AFLCP  173-5 


DARCOM-P  715-S 


NAVMAT  P5240 


DLAH  8315.2 


EVALUATION/DEMONSTRATION  REVIEW  CHECKUST  FOR  C/SCSC 


CHECJCUST  ITEMS 


YES 


NO 


REMARKS 


I.  ORGANIZATION 


1.  DEFINE  ALL  THE  AUTHORIZED  WORK  AND  RELATED  RESOURCES  TO  MEET  THE  REQUIREMENTS  OF 
THE  CONTRACT,  USING  THE  FRAMEWORK  OF  THE  CWBS. 


a.  Is  only  one  CWBS  used  for  the  contract  (attach  copy  of 
CWBS)? 


b.  Is  all  contract  work  included  in  the  CWBS? 


c.  Are  (he  following  items  included  in  the  CWBS  (annotate 
copy  of  CWBS  to  show  elements  below)? 


(1)  Contract  line  items  and  end  items  (if  in  consonance 
with  MIL-STD-881  A). 


(2)  All  CWBS  elements  specified  for  external  reporting. 


(3)  CWBS  elements  to  be  subcontracted,  with  identifica- 
tion of  subcontractors. 


(4)  Cost  account  levels. 


2.  IDENTIFY    THE    INTERNAL    ORGANIZATIONAL    ELEMENTS    AND    THE    MAJOR    SUBCONTRACTORS 
RESPONSIBILE  FOR  ACCOMPLISHING  THE  AUTHORIZED  WORK. 


a.  .Are  all  authorized  tasks  assigned  to  identified  organiza- 
tional elements?  (This  must  occur  at  the  cost  account  level  as  a 
minimum.  Prepare  exhibit  showing  relationships.) 


b.  Is  subcontracted  work  defined  and  identified  to  the 
appropriate  subcontractor  within  the  proper  WBS  element? 
(Provide  representative  example.) 


3.  PROVIDE  FOR  THE  INTEGRATION  OF  THE  CONTRACTOR'S  PLANNING.  SCHEDULING.  BUDGETING. 
WORK  AUTHORIZATION,  AND  COST  ACCUMULATION  SYSTEMS  WITH  EACH  OTHER,  THE  CWBS.  AND  THE 
ORGANIZATIONAL  STRUCTURE.  (Reference  format  1.) 


a.  Are  the  contractor's  management  control  systems  listed 
above  integrated  with  each  other,  the  CWBS.  and  the  organiza- 
tional structure  at  the  following  levels:  (Use  matrix  to  illustrate 
the  relationships.) 


"■:"■:;:;:;:£;:;  .-:;•■.•  ■■•;■;■?•■ 


•.tv.v.: .  .-..•:•.•:■.>:•. 


(1)  Total  contract'' 


(2)  Cost  account? 


4.  IDENTIFY  THE  MANAGERIAL  POSITIONS  RESPONSIBLE  FOR  CONTROLLING  OVERHEAD  i  INDIRECT 
COSTS). 


a.  Are  the  following  organizational  elements  and  managers 
clearly  identified? 


(1)  Those  responsible  for  the  establishment  of  budgets 
and  assignment  ot  resources  for  overhead  performance? 
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CHECKLIST  ITEMS 

YES     |     NO 

REMARKS 

(2)  Those  responsible  for  overhead  performance  control 
of  related  costs. 

b.   Are  the  responsibilities  and  authorities  of  each  of  the 
above  organizational  elements  or  managers  clearly  defined? 

i 

5    PROVIDE   FOR   INTEGRATION  OF  THE  CWBS  WITH  THE  CONTRACTOR'S  FUNCTIONAL  ORGANIZA- 
TIONAL STRUCTURE  IN  A  MANNER  THAT  PERMITS  COST  AND  SCHEDULE  PERFORMANCE  MEASUREMENT 
FOR  CWBS  AND  ORGANIZATIONAL  ELEMENTS.  (Provide  matrix  showing  integration.) 

a.  Is  each  cost  account  assigned  to  a  single  organizational 
element  directly  responsible  for  the  work  and  identifiable  to  a 
single  element  of  the  CWBS? 

b.  Are  the  following  elements  for  measuring  performance 
available  at  the  levels  selected  for  control  and  analysis: 

Sxv^x^.vt^xx^x'-x':  .•■.'.■:■.'        '  .':'  ' 

v/lvlvlvXv 

I..;:      1 

■  1 1  Budgeted  cost  for  work  scheduled? 

(2)  Budgeted  cost  for  work  performed? 

(3)  Actual  costs  of  work  performed? 

11.  PLANNING  AND  BUDGETING 

1.  SCHEDULE  THE  AUTHORIZED  WORK  IN  A  MANNER  WHICH  DESCRIBES  THE  SEQUENCE  OF  WORK  .AND 
IDENTIFIES    THE    SIGNIFICANT   TASK    INTER-DEPENDENCIES   REQUIRED  TO   MEET   THE   DEVELOPMENT. 
PRODUCTION.  AND  DELIVERY  REQUIREMENTS  OF  THE  CONTRACT. 

a.  Does   the  scheduling  system  contain  ("Prepare  exhibit    ]..}•'               f 
showing  iraceability   from  contract  task  level  to  work  package     ':'■:■'■:■.        :-]:: 

schedules.  1—                                                                                     •■ 

, j:;-—    ■ , 

( 1 )  A  master  program  schedule? 

x'x-x'X'X-x 

;..,...^:;:.w.V;V:¥::.::'  :  :    ■■     ;■■■ 

! 

|2)  Intermediate  schedules,  is  required,  which  provide  a     ! 
logical  sequence  irom  the  master  schedule  to  the  cost  account 
level? 

(3)  Detailed  schedules  which  support  cost  account  and 
work  package  start  and  completion  dates/events? 

i 
b     \re  significant  decision  points,  constraints,  and  inter- 
faces  identified  as  kev  milestones? 

■■ 
c.   Does  'he  scneduling  system  provide  lor  the  identifica- 
tion of  work  progress  against  technical  and  other  milestones,  and     I 
also  provide  tor  forecasts  of  completion  dates  of  scheduled  work?     I 

"1 

d.  Are    work    packages    formally   scheduled   in   terms  of    | 
physical  accomplishment  bv  calendar  dates  (Gregorian,  Julian,  or     | 
manufacturing  day)' 

■    —           '■- 1 

2.   IDENTIFY    PHYSICAL    PRODUCTS,    MILESTONES.    TECHNICAL    PERFORMANCE    GOALS.    OR    OTHER 
INDICATORS  THAT  WILL  BE  USED  TO  MEASURE  OUTPUT. 
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CHECKLIST  ITEMS                                             YES 

NO 

REMARKS 

a.   Are  meaningful  indicators  identified  for  use  m  measuring     , 
the  status  of  cost  and  schedule  performance?  (Provide  representa- 
tive samples.) 

b.  Does  the  contractor's  system  identify  work  accomplish- 
ment  against  the  schedule  plan?  (Provide  representative  exam-     J 
pies.) 

e.   Are    current    work    performance    indicators  and  goals     ', 
reiatable  to  original  goals  as  modified  by  contractual  flanges,     1 
replanning,  and  reprogrammuig  actions?  (Provide  exhibit  showing 
incorporation  of  changes  to  original  indicators  and  goals.) 

3.   ESTABLISH  AND  MAINTAIN  A  TIME-PHASE  BUDGET  BASELINE  AT  THE  COST  ACCOUNT  LEVEL  AGAINST 
WHICH  CONTRACT  PERFORMANCE  CAN  BE  MEASURED.  INITIAL  BUDGETS  ESTABLISHED  FOR  THIS  PURPOSE 
WILL  BE  BASED  ON  THE  NEGOTIATED  TARGET  COST.  ANY  OTHER  AMOUNT  USED  FOR  PERFORMANCE 
MEASUREMENT  PURPOSES   MUST  BE   FORMALLY   RECOGNIZED   BY   BOTH  THE  CONTRACTOR  AND  THE 
GOVERNMENT.  (Reference  formats  2  and  8.) 

|;:""":'"x 
a.   Does  the  pertormance  measurement  baseline  consist  of    !._ 

■he  following?                                                                                          .  •  '•  .:  •••:• 

1 

1                                   1                                                              '' 
( 1 )  Time-phase  cost  account  budgets. 

i 

(2)   Higher  level  CWBS  element  budgets  (where  not  yet 
broken  down  into  cost  account  budgets). 

i                  i 

(3)  Undistributed  budget,  if  any. 

(4)  Indirect  budgets,  if  not  included  in  the  above. 

b.  Is   the    entire    contract    planned    in    time-phased   cost 
accounts  to  the  extent  pracUcable' 

I 

c.  In    the   event    that   future   contract  effort   cannot   be 
defined  in  sufficient  detail  to  allow  the  establishment  of  cost 
accounts,    is    the    remaining    budget    assigned    to    the   lowest 
practicable  CWBS  level  elements  for  subsequent  distribution  to 
cost  accounts. 



d.  Does  the  contractor  require  sufficient  detailed  planning 
of  cost  accounts  to  constrain  the  application  of  budget  initially 
allocated    for    future    effort    ;o   current   effort?   (Explain   con- 
straints.) 

e.   Are  cost  accounts  opened  and  closed  based  on  the  start 
and  completion  of  work  contained  ".herein? 

4.   ESTABLISH    BUDCETS   FOR   ALL   AUTHORIZED  WORK   WITH   SEPARATE    IDENTIFICATION   OF  COST 
ELEMENTS  (LABOR.  MATERIAL,  ETC.).  (Reference  formats  2,  3.  and  4.) 

a.   Does  the  budgeting  system  contain:  (Provide  exhibit.) 

••          . 

>:':::x:::::;:>:0::::::--:::.':::-:'::':;:;:;::::::;-:>V::: 

•'•'■'■'.■'.•'.•'.•'.•'.'.•'■• 

(I)  The    total    budget    for    the    contract    (including     j 
estimates  for  authonzed  but  unpriced  work)? 
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CHECKLIST  ITEMS                                             YES 

NO 

REMARKS 

12)  Budget]  assigned  to  major  functional  organizations?     | 
(See  checklist  item  II.  9ab.) 

( 3)  Budgets  assigned  to  cost  accounts? 

b.  Are  the  budgets  assigned  to  cost  accounts  planned  and 
identified  in  terms  of  the  following  cost  elements?  (Reference     j.'.:-: 
Formats  J  and  4.)                                                                                    ^Ayyyyy-yy:: 

£••:£•••&•: 

:[:[:[■.[:'■ '-  yyyyyyyy.  j  :  ■_: ':  ^^yy':yyy-  :'::S:;:'' : 

( 1 )  Direct  labor  dollars  and/or  hours. 

(2)  Material  and/or  subcontract  dollars. 

(3)  Other  direct  dollars. 

c.  Does  the  work  authorization  system  contain:  (Prepare     •  . 

sample  exhibit.)                                                                                       ll-w-Sivlvi: 

(I)  Authorization  to  proceed  with  all  authorized  work? 

(2)  Appropriate  work  authorization  documents  which 
subdivide    the    contractual    effort    and    responsibilities   within 
functional  organizations. 

5.  TO  THE  EXTENT  THE  AUTHORIZED  WORK  CAN  BE  IDENTIFIED  IN  DISCRETE.  SHORT -SPAN  WORK 
PACKAGES.  ESTABLISH  BUDGETS  FOR  THIS  WORK  IN  TERMS  OF  DOLLARS.  HOURS.  OR  OTHER  MEASURABLE 
UNITS.  WHERE  THE  ENTIRE  COST  ACCOUNT  CANNOT  BE  SUBDIVIDED  INTO  DETAILED  WORK  PACKACF.S. 
IDENTIFY  THE  FAR  TERM  EFFORT  IN  LARGER  PLANNING  PACKAGES  FOR  BUDGET  AND  SCHEDULING 
PURPOSES:  (Reference  formats  6.  6a.  and  6b.) 

a.  Do  work  packages  reflect  the  actual  way  in  which  the 
work    will    be    done    and    are    they    meaningful    products   or 
management-onented  subdivisions  of  a  higher  level  element  of 
work'  (Provide  representative  sample.) 

b.   Are  detailed  work  packages  planned  as  far  in  advance  as    1 
practicable1 

c.  Is   work    progressively   subdivided   into  detailed   work 
package)  as  requirements  are  defined? 

d.  Is    future    work    which    cannot    be   planned   in  detail 
subdivided  to  the  extent  practicable  for  budgeting  and  schedule 
purposes.  (Provide  sample.) 

e.   Are  work  packages  reasonably  short  in  time  duration  or 
do   ihey   have  adequate  objective  indicators/milestones  to  mini- 
mize the  in-process  work  evaluation? 

f    Do  work   aackages  consist  oi  discrete  tasks  which  are 
adequately  described^  iProvide  representative  sample,  i 

I     -      -         -I 

g.   Can    the    contractor    substantiate    work    package    and    j 
planning  package  budgets? 

.   „  J 

i 

1 

h.    Are  budgets  or  values  assigned  to  work  packages  and 
planning  packages  in  lerms  of  dollars,  hours,  or  other  measurable 
units' 

-  . .  . 

Do 
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CHECKLIST  ITEMS                                             YES 

1 

NO                          REMARKS 

S                       1                                        1 

i.   Are  work  packages  assigned  :o  performing  organizations? 

!                i                 i 

o.  PROVIDE  THAT  THE  SUM  OF  ALL  WORK  PACKAGE  BUDGETS  PLUS  PLANNING  PACKAGES  WITHIN  A 
COST  ACCOUNT  EQUALS  THE  COST  ACCOUNT  BUDGET.  (Reference  format  2.) 

1                 1                  ! 
a.  Does  the  sum  ot  all  work  package  budgets  plus  planning 

packages  within  cost  accounts  equal  the  budgets  assigned  to  those 

cost  accounts? 

7.   IDENTIFY  RELATIONSHIPS  OF   BUDGETS  OR  STANDARDS  IN  UNDERLYING  WORK  AUTHORIZATION 
SYSTEMS  TO  BUDGETS  FOR  WORK  PACKAGES. 

a.  Where   engineered    standards   or   other   internal    work 
measurement   systems  are  used,  is  there  a  formal  relationship 
between    these    values    and    work    package    budgets?   (Provide 
samples  showing  relationships.) 

8.  IDENTIFY  .AND  CONTROL  LEVEL  OF  EFFORT  ACTIVITY  BY  TIME-PHASE  BUDGETS  ESTABLISHED  FOR 
THIS  PURPOSE.  ONLY  THAT  EFFORT  WHICH  CANNOT  BE  IDENTIFIED  .AS  DISCRETE.  SHORTSPAN  WORK 
PACKAGES  OR  AS  APPORTIONED  EFFORT  WILL  BE  CLASSED  .AS  LOE.  fReference  format  6.) 

a.  Are   time-phase  budgets  established   for   planning  and 
control  of  level  of  effort  activity  by  category  ^(  resource;  for 
example,  type  of  manpower  and/or  material?  (Explain  method  of 
control  and  analysis.) 

b.   Is  work  properly  classified  as  measured  effort,  LOE,  or 
apportioned  effort  and  appropriately  separated? 

9    ESTABLISH  OVERHEAD  BUDGETS  FOR  THE  TOTAL  COSTS  OF  EACH  SIGNIFICANT  ORGANIZATIONAL 
COMPONENT  WHOSE  EXPENSES  WILL  BECOME  INDIRECT  COSTS.  REFLECT  IN  THE  CONTRACT  BUDGETS  AT 
THE   APPROPRIATE   LEVEL.  THE   .AMOUNTS   IN   OVERHEAD  POOLS  THAT  WILL  BE  ALLOCATED  TO  THE 
CONTRACT  AS  INDIRECT  COSTS.  (Reference  DCAA  Audit  Manual  and  DAR  1 5-:03. )  ( Reference  formal  1  ) 

| 

j.  Are  overhead  cost  budgets  (or  projections)  established 
on   a   facility-wide   basis  at   least   annually  for  the  life  of  the    1 
contract? 

b.   Are  overhead  cost  budgets  estaolished  for  each  organiza-    j 
tion  which  has  authority  to  incur  overhead  costs? 

'• 1                 l i                                                              i 

c.   Are  ill  elements  of  expense  identified  to  overhead  cost 
budgets  or  projections? 


d.  Are  overhead  budgets  and  costs  being  handled  according 
tu  the  disclosure  statement  when  applicable,  or  otherwise 
prnperlv  classified  (for  example,  engineering  overhead.  1R&D)? 


e.  Is   the   anticipated   (firm   and  potential)  business  base 
projected  in  a  rational,  consistent  manner'  (Explain.) 

1 

t.   Are    overhead    costs    budgets    established    on    a    basis 
consistent  with  the  anticipated  direct  business  base? 

i.   Are   the   requirements  for  all  items  of  overhead  estab-    j 
j      ished  by  rational,  traceable  processes1 
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1 [              1 

CHECKLIST  ITEMS                                             YES          NO 

REMARKS 

h.    \rc     (he    overhead     pools     formally    and    adequately 
identified?  (Provide  u  list  of  the  pools.) 

i-   Are  the  organizations  and  items  of  cost  assigned  to  each 
pool  identified? 

j.   Are    projected   overhead    costs  in   each   pool   and   the    j 
associated  direct  costs  used  as  the  basis  tor  establishing   ntenm 
rates  for  allocating  overhead  to  contracts? 

'v.;.x-x>"T:f!v:'v:-!'T!':'!T 
k.   Are  protected  overhead  rates  applied  to  the  contract                    f    '.' 
beyond  the  current  vear  based  on—                                                                        f 

( 1 )  Contractor  financial  periods;  for  example,  annual? 

(2)  The  projected  business  base  for  each  penod? 

(3)  Contemplated  overhead  expenditure  for  each  period 
based  on  the  best  information  currently  available? 

1.    Are  overhead  projections  adjusted  in  a  timely  manner  to 
reflect - 

u .....    ...      j 

[:••:•• 

>:• 

.::'.'.■      - 

•:•:•:•:•:•:•:•:■:•:•:• 

i*::£:££ii:*:-: 

( 1 )  Changes  in  the  current  direct  and  projected  base? 

(2)  Changes  in  the  nature  of  the  overhead  requirements? 

i_ _.. 

(3)  Changes  in  the  overhead  pool  and/or  organization 
structures'' 

m.  .Are  the  WBS  and  organizational  levels  for  application  of 
the  projected  overhead  costs  identified? 

!0.   IDENTIFY  MANAGEMENT  RESERVES  AND  UNDISTRIBUTED  BUDGET. 

1             1             1                                              ! 

a.   Is  all  budget  available  as  management  reserve  identified    | 
jnd  excluded  from  the  performance  measurement  baseline? 

b    Are    records    maintained    to    show    how    management 
reserves  are  used""  (Provide  exhibit.) 

c.   Is  undistributed  budget  limited  to  contract  effort  which 
jannol  vet  be  planned  to  CWBS  elements  at  or  below  the  level 
specified  for  reporting  to  the  Government'' 

d.   .Are    records    maintained    to   show   how   undistributed 
budgets  arc  jontrolled'1  (Provide  exhibit.) 

; 

II.  PROVIDE  THAT  THE  CONTRACT  TARGET  COST  PLUS  THE  ESTIMATED  COST  OF  AUTHORIZED  BUT 
UNPRICED    WORK    IS    RECONCILED    WITH    THE    SUM    OF    ALL    INTERNAL    CONTRACT    BUDGETS    ANT) 
MANAGEMENT  RESERVES.  1  Reference  formats  3.  4.  and  5.) 

Ill 
a.   Does  the  contractor  s  system  description  or  procedures 

require  that  the  pertormance  measurement  baseline  plus  manage-    ' 

ment  reserve  equal  the  contract  budget  base? 
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CHECKLIST  ITEMS 


YES 


NO 


REMARKS 


b.  Do  the  sum  of  the  cost  account  budgets  for  higher  level 
CWBS  dements,  undistributed  budget,  and  management  reserves 
reconcile  with  the  contract  target  cost  plus  the  estimated  cost  for 
authorized  unpriced  work11  !  "Provide  exhibit. I 


III.    ACCOUNTING 


I     RECORD   DIRECT  COSTS  ON   .AN   APPLIED  OR   OTHER  ACCEPTABLE   BASIS  CONSISTENT  WITH 
BUDGETS  IN  A  FORMAL  SYSTEM  THAT  IS  CONTROLLED  BY  THE  GENERAL  BOOKS  OF  ACCOUNT. 


THE 


a.   Does  the  accounting  system  provide  a  basis  for  auditing 
records  of  direct  costs  chargeable  to  the  contract? 


b.  Are  elements  of  direct  cost  (labor,  material,  and  so 
forth)  accumulated  within  cost  accounts  in  a  manner  consistent 
with  budgets  using  recognized  acceptable  costing  techniques  and 
controlled  bv  the  geneial  books  of  account' 


1  SUMMARIZE  DIRECT  COSTS  FROM  THE  COST  ACCOUNTS  INTO  THE  WBS  WITHOUT  ALLOCATION  OF 
SINGLE  COST  ACCOUNT  TO  TWO  OR  MORE  WBS  ELEMENTS.  ( Reference  format  3.) 

a.  Is  it  possible  to  summarize  direct  costs  from  the  cost 
account  level  through  the  CWBS  to  the  total  contract  level 
without  allocation  of  a  lower  level  CWBS  element  to  two  or  more 
higher  level  CWBS  elements?  (This  Joes  not  preclude  the 
■(location  of  costs  from  a  cost  account  containing  common  items 
io  jpproonate  using  cost  accounts.) 

3.  SUMMARIZE  DIRECT  COSTS  FROM  THE  COST  \CCOUNTS  INTO  THE  CONTRACTOR'S  FUNCTIONAL 
ORGANIZATIONAL  ELEMENTS  WITHOUT  ALLOCATION  OF  A  SINGLE  COST  ACCOUNT  TO  TWO  OR  MORE 
ORGANIZATIONAL  ELEMENTS.  (Reference  format  4.) 


a.  Is  it  possible  to  summarize  direct  costs  from  the  cost 
account  level  to  the  highest  functional  organizational  level 
without  allocation  ^>(  a  lower  ievel  organization's  cost  to  two  or 
more  higher  level  organizations' 


4    RECORD  ALL  INDIRECT  COSTS  WHICH  WILL  BE  ALLOCATED  TO  THE  CONTRACT 


a.  Does  the  cost  accumulation  system  provide  for  summari- 
zation of  indirect  costs  from  the  point  of  allocation  to  the 
contract  total9 


h.    Are  indirect  costs  accumulated  for  comparison  with  the 
^orresoonding  budgets? 


c.  Do  .he  lines  oi  authority  for  incurring  indirect  costs 
.orrespond  to  the  lines  oi  resraonsibiiity  for  management  control 
of  the  same  components  of  costs'  (Explain  controls  for  fixed  and 
•  anable  indirect  .cists.) 


J.    Are   indirect  costs  charged  to  the  appropnate  indirect 
'     tiools  and  incurring  organization? 


e.    Vre  ihe  bases  and  rates  for  allocating  costs  from  each 
indirect  pool  consistently  applied" 
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CHECKUST  ITEMS 

YES 

NO 

REMARKS 

f.  Are  the  bases  and  rates  for  allocating  costs  from  each 
indirect  pool  to  commercial  work  consistent  with  those  used  to 
lllocate  such  costs  to  Government  contracts? 

g.   Are  the  rates  lor  allocating  costs  from  each  indirect  cost    1 
pool   to  contracts  updated   as  necessary   to  ensure   a  realistic 
monthly  allocation  of  indirect  costs  without  significant  year-end    J 
adjustments? 

h.   Are   the   procedures   for  identifying  indirect  costs  to    j 
incurring  organizations,  indirect  cost  pools,  and  allocating  the 
costs  from  the  pools  to  the  contracts  formally  documented? 

1                i 

5.  IDENTIFY  THE  BASES  FOR  ALLOCATING  THE  COST  OF  APPORTIONED  EFFORT 

a.  Is   effort    which  is  planned   and  controlled  in  direct 
relationship  to  cost   accounts  or   work   packages  identified  as 
apportioned  effort? 

b.   Are  methods  used  for  applying  apportioned  effort  costs 
to  cost   jccounts   applied   consistently   and  documented  in  an 
established  procedure? 

6.  IDENTIFY  UNIT  COSTS.  EQUIVALENT  UNIT  COSTS.  OR  LOT  COSTS  AS  APPLICABLE. 

a.  Does  the  contractor's  system  provide  unit  costs,  equiva-    | 
lent  unit  or  lot  costs  in  terms  of  labor,  matenal,  other  direct,  and 
indirect  costs1  (Describe  procedure.) 

b.   Does    the    contractor   have    procedures    which   permit    j 
identification  of  recurring  or  nonrecurring  costs  as  necessary? 

7.  THE    CONTRACTOR'S    MATERIAL    ACCOUNTING    SYSTEM    WILL    PROVIDE    FOR:    ACCURATE   COST 
ACCUMULATION  AND  ASSIGNMENT  OF  COSTS  TO  COST  ACCOUNTS  IN  A  MANNER  CONSISTENT  WITH  THE 
BUDGETS   USING   RECOGNIZED.   ACCEPTABLE  COSTING  TECHNIQUES,  DETERMINATION  OF  PRICE  VARI- 
ANCES BY  COMPARING  PLANNED  VERSUS  ACTUAL  COMMITMENTS,  COST  PERFORMANCE  MEASUREMENT  AT     j 
THE  POINT  IN  THE  MOST  SUITABLE  FOR  THE  CATEGORY  OF  MATERIAL  INVOLVED.  BUT  NO  EARLIER  THAN     j 
THE  TIME  OF  ACTUAL  RECEIPT  OF  MATERIAL.  DETERMINATION  OF  COST  VARIANCES  ATTRIBUTABLE  TO 
THE  EXCESS  USAGE  OF  MATERIAL.  DETERMINATION  OF  UNIT  OR  LOT  COSTS  WHEN  APPLICABLE.  .AND  FULL 
ACCOUNTABILITY   FOR    ALL  MATERIAL  PURCHASED   FOR   THE   CONTRACT   INCLUDING   THE  RESIDUAL 
INVENTORY 

a.   Does  the  contractor's  svstem  provide  for  accurate  cost    [ 
accumulation    and    assignment    to  cost   accounts   in   a   manner 
consistent  with  the  budgets  using  recognized  acceptable  costing 
techniques? 

b.    Are  matenal  costs  reported  within  :he  same  period  as    \ 
that  in  which  BCVYP  ;s  earned  for  that  matenal? 

c.   Does  the  contractor's  system  provide  for  determination 
>>f  price  vanances  by  comparing  planned  vs  actual  commitments?    ! 

d.   Is  cost  performance  measurement  at  the  point  in  nme    I 
most  suitable  for  :he  category  of  matenal  involved,  but  no  earuer 
thin  the  nme  of  actual  receipt  of  matenal? 

QC 
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e.  Does  the  contractor's  system  provide  for  the  determina- 
tion of  cost  variances  attributable  to  the  excess  usage  of  material? 


f.   Does  the  contractor's  system  provide  unit  or  lot  costs 
when  applicable? 


g.  Are  records  maintained  to  show  full  accountability  for 
all  material  purchased  for  the  contract,  including  the  residual 
inventory' 


IV     ANALYSIS 


I.  IDENTIFY  AT  THE  COST  ACCOUNT  LEVEL  ON  A  MONTHLY  BASIS  USING  DATA  FROM.  OR 
RECONCILABLE  WITH.  THE  ACCOUNTING  SYSTEM;  BCWS  .AND  BCWP.  BCWP  AND  APPLIED  (ACTUAL  WHERE 
APPROPRIATE)  DIRECT  COSTS  FOR  THE  SAME  WORK;  VARIANCES  RESULTING  FROM  THE  ABOVE 
COMPARISONS  CLASSIFIED  IN  TERMS  OF  LABOR,  MATERIAL.  OR  OTHER  APPROPRIATE  ELEMENTS. 
TOGETHER  WITH  THE  REASONS  FOR  SIGNIFICANT  VARIANCES. 


a.  Does  the  contractor's  system  include  procedures  for 
Tieasuring  performance  o(  the  lowest  level  organization  respon- 
sible for  the  cost  account1  (Provide  typical  example.) 


b.  Does   the   contractor's  system  include  procedures  for 
measuring  the  performance  of  critical  subcontractors? 


c.   Is  cost  and  schedule  performance  measurement  done  in  a 
consistent,  systematic  manner' 


i.    Are  the  actual  costs  used  for  variance  analysis  reconcil- 
able with  data  from  the  accounting  system1 


e.  Is  budgeted  cost  for  work  performed  calculated  m  a 
manner  consistent  with  the  way  work  is  planned?  I  For  example, 
if  work  is  planned  on  a  measured  basis,  budgeted  cost  for  work 
performed  is  calculated  on  a  measured  basis.) 


f.  Does  the  contractor  have  variance  analysis  procedures  : 

ind  a  demonstrated  capability  for  identifying  (at  the  cost  account  ; 

and  other  appropriate  levels)  cost  and  schedule  variances  resulting  ;: 
'rom  the  svstem  ( provide  examples)  which— 


(1)   Identify  and  isolate   problems  causing  unfavorable 
.ost  variances' 


(2)   Evaluate    the    impact   of   schedule   changes,   work- 
around, etc? 


(3)   Evaluate    the    performance   of  operating   orgaruza- 


(4>  Identify  potential  or  actual  overruns  and  underruns? 


:.  IDENTIFY  ON  *  MONTHLY  BASIS.  IN  THE  DETAIL  NEEDED  BY  MANAGEMENT  FOR  EFFECTIVE 
CONTROL.  BUDGETED  INDIRECT  COSTS.  ACTUAL  INDIRECT  COSTS.  AND  VARIANCES,  ALONG  WITH  THE 
REASONS  (Relerencc  format  7.) 


r  *-» 

0  J 
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Appendix  E  -continued 


CHECKLIST  ITEMS 

YES   j       NO 

REMARKS 

a.   Are  variances  between  budgeted  and  actual  indirect  costs 
identified  and  analyzed  at  the  level  of  assigned  responsibility  for 
their  control  (indirect  pool,  department,  etc.)? 

b.  Does  the  contractor's  cost  control  system  provide  for 
capability  to  identify  the  existence  and  causes  of  cost  variances 
resulting  from- 

:v:-:vf;xWx 

(1)  Incurrence    of  actual   indirect  costs  in  excess  of 
budgets,  by  element  of  expense? 

(2)  Changes  in  the  direct  base  to  which  overhead  costs 
are  allocated? 

c.  Are  management  actions  taken  to  reduce  indirect  costs 
when  there  are  significant  adverse  variances? 

3.  SUMMARIZE  THE  DATA  ELEMENTS  AND  ASSOCIATED  VARIANCES  LISTED  IN  ITEMS  1  AND  2  ABOVE 
THROUGH  THE  CONTRACTOR  ORGANIZATION  AND  WBS  TO  THE  REPORTING  LEVEL  SPECIFIED  IN  THE 
CONTRACT.  (Reference  formats  2.  3, 4,  5 ,  10,  and  1 1 .) 

a.  Are  data  elements  (BCWS,  BCWP,  and  ACWP)  progres- 
sively  summarized   from  the  detail  level  to  the  contract  level 
through  the  CWBS?  (Provide  exhibit.) 

b.  Are  data  elements  summarized  through  the  functional 
organizational  structure  for  progressively  higher  levels  of  manage- 
ment'' (Provide  exhibit.) 

c.  Are  data  elements  reconcilable  between  internal  sum- 
mary reports  and  reports  forwarded  to  the  Government? 

d.   Are  procedures  for  variance  analysis  documented  and 
consistently  applied  at  -he  cost  account  level  and  selected  WBS 
and   organizational   levels   at   least  monthly  as  a  routine  task? 
(Provide  examples.) 

4    IDENTIFY  ON   A   MONTHLY   BASIS   SIGNIFICANT  DIFFERENCES   BETWEEN   PLANNED   .AND  ACTUAL 
SCHEDULE  ACCOMPLISHMENT  TOGETHER  WITH  THE  REASONS. 

a.  Does  the  scheduling  system  identify  in  a  timely  manner 
the  status  of  work?  (Provide  representative  examples.) 

b.   Does  the  contractor  use  objective  results,  design  reviews, 
and  tests  to  trace  schedule  performance7  (Provide  examples.) 

5.  IDENTIFY  MANAGERIAL  ACTIONS  TAKEN  AS  A  RESULT  OF  CRITERIA  ITEMS  1  THROUGH  4  .ABOVE. 

! 

a.   Is  data  disseminated  to  the  contractor's  managers  timely,  j 
accurate,  and  usable'  (Provide  examples.) 

' 

1 

b.    Are  lata  being  used  by  managers  in  an  effective  manner 

to  ascertain  program  or  functional  status,  to  identify  reasons  for 
j     significant  variance,  and  to  inmate  appropriate  corrective  action' 

(Provide  examples.) 
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CHECKUST  ITEMS 

YES 

NO                            REMARKS 

c.   Are   'here   procedures  tor  monitoring  action  items  and 
J     corrective    actions    to    the    point   of   resolution    and    are    these 
procedures  being  followed? 

l 

6.  BASED  ON  PERFORMANCE  TO  DATE  .AND  ON  ESTIMATES  OF  FUTURE  CONDITIONS.  DEVELOP  REVISED 
ESTIMATES  OF  COST  AT  COMPLETION  FOR  WBS  ELEMENTS  IDENTIFIED  IN  THE  CONTRACT  AND  COMPARE 
i     THESE  WITH  THE  CONTRACT  BUDGET  BASE  AND  THE   LATEST  STATEMENT  OF  FUNDS  REQUIREMENTS     j 
REPORT  TO  THE  GOVERNMENT.  (Reference  formats  12,  13.  and  14.) 

i     Vre  ^sumatesot  costs  at  completion  based  on-                    F xx ■'■:■■'■:'■:■:■:■■ 

mmm 

•:•:•:■:•:•:•:•:•:•:•:• 

■ ■:■: :■■ 

X'.'-X-X-X  XX'X  X  .  X-XX  X'X-X'XvX-X-X-XvX 

i"  '"     '■'■•■' 
( 1 )  Performance  to  date ' 

J. 



(2)  Actual  costs  to  date? 

(3)  Knowledgeable  projections  of  future  performance1 

(4)  Estimates  of  the  cost  for  contract  work  remaining  to  I 
be  accomplished  constdenng  economic  escalation? 

i        — -                                                                  i:!:^:"":":1' 

•r—"  -■  ■■ 

:x!::::::;:/r ■"■■■■..■.•      !  ZSg$mS5:- 

b.   Are  the  overhead  rates  used  to  develop  the  contract  cost    •      ...    }:; 
estimate  to  complete  based  on-                                                           |i:x:x'          ft 

11)  Historical  expenence? 

1 

1 2)  Contemplated  management  improvements? 

j                   (3)  Proiected  economic  escalation' 

i                                 I                                                          l 

(4)   The  anticipated  business  volume? 

1 

c.   Are   estimates   ot   cost    at   completion    generated    *tth 
\     sufficient    frequency    to  provide   identification  of  future   cost 
problems  in  time  for  possible  corrective  or  preventive  actions  by 
;     both  the  contractor  and  the  Government  program  manager' 

d.  Are  estimates  developed  by  program  personnel  coordi- 
nated with   those   responsible   for  overall  plant  management   to 
determine  whether  required  resources  will  be  available  according 
to  revised  planning? 

e.   Are    estimates    of   cost   at    completion    generated    by 
Knowledgeable  personnel  for  the  following  levels: 

i|  : 

■J:-:-:  ::x:::x::|f:::;: 

\                  J 

1  1 )  Cost  accounts' 

'                                                                                                                                     i 

I  21   Major  functional  areas  of  contract  effort'' 

1                ! 
1  3)  Major  subcontracts? 

14)  WBS  elements  contractually  specified  for  reporting 
1     of  status  to  the  Government  I  lowest  ievel  oniv)? 

1 

(5)  Total  contract  (all  authorized  work)? 

'                  j 
:.   Are  the  latest  revised  estimates  ot  costs  at  completion 

compared  with  the  established  budgets  at  approonate  levels  and    i 

causes  of  variances  identified? 
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YES 

NO                          REMARKS 

g.  Are  estimates  oi  cost   at   completion   generated   in   a 
rational,    consistent    manner'    Are    procedures   established   for 
appropriate  aspects  of  generating  estimates  of  costs  at  comple- 
tion? 

h.  Are    estimates    of    costs    at    completion    utilized    in 
determining  contract  funding  requirements  and  reporting  them  to 
the  Government? 

1.  Are  the  contractor's  estimates  of  costs  at  completion 
reconcilable  with  cost  data  reported  to  the  Government? 

1 

V.   REVISIONS  AND  ACCESS  TO  DATA 

1.  INCORPORATE  CONTRACTUAL  CHANGES  IN  A  TIMELY  MANNER.  RECORDING  THE  EFFECTS  OF  SUCH 
CHANGES  IN  BUDGETS  .AND  SCHEDULES.  IN  THE  DIRECTED  EFFORT  BEFORE  NEGOTIATION  OF  A  CHANGE. 
BASE  SUCH  REVISIONS  ON  THE  .AMOUNT  ESTIMATED  AND  BUDGETED  TO  THE  FUNCTIONAL  ORGANIZA- 
TIONS. 

a.  Are  authorized  changes  being  incorporated  in  a  timely 
manner? 

b.  Are   oil  affected   work  authorizations,  budgeting,  and 
scheduling  documents  amended  to  properly  reflect  the  effects  of 
authorized  changes?  (Provide  examples.) 

c.  Are   internal   budgets   for   authonzed,  but   not   priced 
changes  based  on  the  contractor's  resource  plan  for  accomplishing 
the  work? 

d.   If  current  budgets  tor  authonzed  changes  do  not  sum  to   1 
the    negotiated    cost    for    the    changes,    does    'die    contractor  1 
compensate   for  the   differences  by   revising   the  undistnbuted   [ 
budgets,  management  reserves,  budgets  established  for  work  not   | 
yet  started,  or  by  a  combination  of  these' 

2.   RECONCILE  ORIGINAL  BUDGETS  FOR  THOSE  ELEMENTS  OF  THE  WBS  IDENTIFIED  AS  PRICE  LINE 
ITEMS  IN  THE  CONTRACT.  AND  FOR  THOSE  ELEMENTS  AT  THE  LOWEST  LEVEL  OF  THE  DOD  PROJECT 
SUMMARY  WBS.  WITH  CURRENT  PERFORMANCE  MEASUREMENT  BUDGETS  IN  TERMS  OF  CHANGES  TO  THE 
AUTHORIZED   WORK    AND    INTERNAL    REPLANNING    IN    THE    DETAIL    NEEDED   BY   MANAGEMENT   FOR 
EFFECTIVE  CONTROL.  1  Reference  formats  8  and  9.) 

a.   Are    current    budgets    resulting    from    changes    to    the 
authonzed    work    and/or    internal    replanmng,    reconcilable    to 
ongtnal  budgets  for  specified  reporting  items' 

3    PROHIBIT   RETROACTIVE  CHANGES  TO  RECORDS  PERTAINING  TO  WORK  PERFORMED  THAT  WILL 
CHAMGE  PREVIOUSLY  REPORTED  AMOUNTS  FOR  DIRECT  COSTS.  INDIRECT  COSTS.  OR  BUDGETS.  EXCEPT 
FOR  CORRECTION  OF  ERRORS  AND  ROUTINE  ACCOUNTING  ADJUSTMENTS. 

1.    \re  retroactive  changes  to  direct  costs  and  indirect  costs   ' 
prohibited    except    for    the    correction    of   errors    and    routine 
accounting  adjustments' 

i 

.   .    ...  ^_^___ ^__ 
b.   Are  direct   or   indirect   cost  adjustments  being  accom-   i 
pushed  according  to  accounting  procedures  acceptable  to  DCAA?    1 

. 1 J — 
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CHECKLIST  ITEMS                                             YES    !       NO     <                      REMARKS 

| 

c.    \re  retroactive  changes  to  BCWS  and  BC'WP  prohibited   j 
except    tor    correction    or"    errors    or    tor    norma]    accounting   j 
adjustments? 

i 

4.  PREVENT    REVISIONS    TO   THE   CONTRACT    BUDGET    BASE    EXCEPT   FOR  GOVERNMENT-DIRECTED     j 
CHANGES  TO  CONTRACTUAL  EFFORT. 

a.   Are  procedures  established  to  orevent  changes  to  the 
contract  budget  base  (see  definition)  other  than  those  authorized 
by  contractual  action' 

b.  Is  authorization  of  budgets  in  excess  of  the  contract 
budget    base    controlled    formally    and    done    with    the    full 
knowledge  and  recognition  of  the  procuring  activity''  Are  the 
procedures  adequate? 

i 

5.  DOCUMENT.  INTERNALLY,  CHANGES  TO  THE  PERFORMANCE  MEASUREMENT  BASEUNE  AND.  ON  A 
TIMELY  BASIS.  NOTIFY  THE  PROCURING  ACTIVITY  THROUGH  PRESCRIBED  PROCEDURES. 

a.  Are  changes  to  the  performance  measurement  baseline 
made  as  a   result   oi  contractual  redirection,  formal  -eprogram-   , 
-rung,  internal  replannuig,  application  of  undistributed  budget,  or   1 
the    use    of    management    reserve,    properly    documented    and  ' 
reflected  in  the  Cost  Performance  Report'' 

b.   Are   procedures   in   existence     hat    restrict   changes  to 
budgets    for    open    work    packages,    and   are   these   procedures 
adhered  to? 

c.   Are  retroactive  changes  to  budeets  tor  completed  work    j 
specifically  prohibited  in  an  established  procedure,  and  is  this    i 
procedure  adhered  to? 

...(._    .... 

d.    Are  procedures  in  existence  that  control  replannuig  of 
unopened  work  packages,  and  are  these  procedures  adhered  to? 

! 

6.  PROVIDE  THE  CONTRACTING  OFFICER  AND  DULY  AUTHORIZED  REPRESENTATIVES  ACCESS  TO  ALL 
OF  THE  FOREGOING  INFORMATION  AND  SUPPORTING  DOCUMENTS. 

a.   Does  the  contractor  provide  access  to  all  pertinent  rec- 
ords to  the  C  SCSC  Review  Team  and  surveillance  personnel'' 

T 
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